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SOME  PROBLEMS  IN 

GERMAN  TO  ENGLISH  MACHINE  TRANSLATION 
by 

Gretchen  Purkhiser  Broun 


ABSTRACT 


Thie  paper  discusses  soee  probiees  in  the  aachine  translation  of  natural 
language,  in  particular,  for  translation  froe  Gerean  into  English.  An 
impieaentation  of  soee  parts  of  the  translating  process  has  been  built.  The 
syetee  consists  of  a Gerean  interpretive  graaear,  to  take  in  Geraan  teat  and 
output  a set  of  seaantic  representations,  and  a generator,  to  produce  English 
sentences  froa  single  eeaantic  representations.  Although  based  on  the 
aeeuaption  that  understanding  is  necessary  for  correct  translation  of  text, 
the  eyetea  does  not  now  contain  en  understand if-g  cosponent  to  choose  betueen 
eeaantic  representations.  The  representation  of  knouiedge  and  its  use  in 
natural  language  understanding  ie  a research  area  that  is  already  under 
intensive  investigation  elsewhere.  The  iapieaentation  described  here  ie  baaed 
on  a sy  steal*;  graaear  analysis  of  Geraan  and  English,  and  it  applies  and 
extends  the  uork  of  Minograd.  Special  attention  is  paid  to  questions  of 
eeaantic  representation  in  a aulti -language  setting  and  to  stylistic  ieeuee  in 
English  generation. 


This  report  is  a revised  version  of  a thesis  rubai ttod  to  the  Departaent  cf 
Electrical  Engineering  on  January  23,  1974  in  partial  fuifiiiaent  of  the 
requi resents  for  the  Degrees  of  Master  of  Science  and  Electrical  Engineer. 
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Chapter  1 ~ Introduction 
1.1  The  Probiee 

The  following  pages  deecribe  a Model  of  the  translating  process,  in 
particuiar,  a system  designed  to  accept  German  text  and  produce  an  Engiish 
translation.  The  mode)  is  not  in  any  sense  a complete  one,  especially  in  the 
cruciai  area  of  language  understanding.  An  implementation  of  some  parte  of 
the  model,  however,  has  been  written.  In  view  of  the  considerable  hietorg  of 
the  mechanical  translation  problem,  I should  stress  that  the  objective  of  thie 
project  uas  not  to  construct  a large-scale  working  system  but  rather  to  see 
how  far  some  existing  programs  and  techniques  couid  go  in  handling  a group  of 
probie  3 that  come  up  in  text. 

Does  it  even  make  sense  to  speak  of  mechanical  translation  as  an 
independent  problem?  In  the  early  60’ e it  was  widely  recognized  that 
mechanical  translation  required  the  fuii  resources  of  language  understanding. 

If  the  translating  process  is  strict iy  a matter  of  understanding  in  one 
language  and  generating  in  another,  doss  the  mechanise!  translation  problem  as 
such  merit  attention?  I think  it  is  fair  to  answer  "yes”  to  this  question. 
Translation  seems  to  require  the  full  power  of  language  interpretation  but  not 
the  full  power  of  generation.  The  hardest  problem  of  generation,  ovciding 
what  to  acy  and  organizing  the  message,  ie  generally  not  at  issue  in 
translation.  So  translation  offers  a somewhat  circumscribed  context  within 
uhich  to  discuss  issues  of  understanding,  language  representation,  and 
production. 

The  translation  probiew  also  hae  the  attraction  of  a readable  output, 
namely  the  translation.  The  output  is  a criterion  by  which  eucceee  may  he 
measured,  although  of  course  there  are  a number  of  pitfaiie  here*  first,  it  ie 


is 

not  hard  to  recognize,  but  rather  difficult  to  describe,  what  a good 
translation  is.  Second,  a limited  system  like  the  one  diecussed  here  can  be 
groomed  to  accept  particular  sentences  gracefully,  so  that  its  performance 
cannot  ,.*uly  be  judged  either  on  the  text  it  can  process  successfully  or  on 
the  no  doubt  unlimited  amount  of  text  for  which  it  will  sputter  and  die.  Once 
we  know  the  scope  of  a particular  system,  however,  we  can  use  a given  output, 
or  a lack  of  one,  as  a basis  for  comparisons  and  evaluations.  Through  the  MT 
problem,  then,  it  Is  possible  to  consider  some  problems  common  to  a number  of 
areas  of  natural  language  processing. 

1.2  The  Evolution  of  the  Problem 

If  the  translating  system  discussed  here  Is  not  in  any  sense  a "solution" 
to  the  mechanical  translation  problem,  it  does  represent  the  evolution  that 
has  occurred  since  Uarren  Heaver's  1949  memorandum  on  the  subject.  In  its  25 
year  history,  mechanical  translation  has  not  really  been  involved  with  a 
single  problem,  but  rather  there  have  been  a series  of  problems,  as  each 
system  that  was  built  pointed  up  other  areas  that  needed  attention.  Earlieet 
attempts  at  HT  were  essentially  mechanized  dictlonarier , doing  substitutions 
on  a word-by-word  basis.  Any  more  involved  processing  was  left  to  human  pre- 
and  post-editors.  Uhen  it  became  clear  that  word-by-word  substitutions  did 
not  produce  acceptable  translations,  the  problem  was  reflneu  to  include 
syntactic  recognition.  Attention  in  the  50’s  and  early  60’s  was  centered  on 
parsing  with,  for  example,  Oettinger's  predictive  analysis,  or  top-down, 
approach  and  the  work  of  Yvnge's  group  at  HIT.  The  more  sophisticated  the 
approach  to  syntax  became,  however,  the  more  sharply  the  nagging  problem  of 
syntactic  ambiguity  came  into  focus.  Mechanical  translation  began  to  mean 
semantics  as  weli  as  syntax,  but  It  was  not  exactly  clear  what  semantics 
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Meant.  Three  approaches  represented  United  answers*  probabilities  of 
lexical  co-occurence  could  be  used  to  select  the  * likeliest"  parse,  a group  of 
semantic  categories  such  as  abstract-concrete  could  be  used  to  restrict 
participants  in  a grannatical  relation,  and  a fixed  set  of  keywords  cuulri  be 
used  to  choose  possible  Interpretations  and  hence  possible  paroee.  However, 
as  Ber-Hlllel  and  others  remarked,  even  if  such  Methods  could  claim  90X 
reliability,  they  would  have  the  disquieting  property  that  it  would  be 
impossible  to  predict  where  the  errors  would  occur.  A systematic  approach  to 
seeantics  was  neceseary. 

In  recognition  of  the  difficulty  of  thlc  "new"  Mechanical  translation 
problem,  support  for  short-term,  i.e.  practical,  projects  dried  up.  The  early 
60's  saw  a shift  away  from  attempts  to  build  working  systems  to  an  emphasle  on 
more  basic  research.  Limited  deduction  came  Into  use  in  systems  such  as  that 
of  Raphael  (29)  with  the  implication  that  language  use  included  not  only  a 
static  "meaning"  but  also  a deductive  ability  as  well.  Then  in  1970  with  the 
development  of  PLANNER  and  Uinograd’s  question-answering  system,  the  "limited” 
was  deleted,  and  more  general  deductive  ability  was  advocated  for  natural 
language  processing.  Implicit  in  Uinograd’s  system,  but  not  clearly  evident 
because  of  its  question-answering  nature,  was  also  the  recognition  that  a 
sentence  is  not  really  an  independent  semantic  unit  but  instead  part  of  a 
larger  context.  Eugene  Charniak's  detailed  analysis  (2)  of  the  problems  of 
dealing  with  context  Implet*  that  sentence-by-sentence  approaches  must  go  the 
way  of  word-by-word  translating  systems.  This  is  not  to  say  that  the  sentence 
is  not  an  important  basic  unit,  but  it  does  imply  that  the  only  system  that 
has  a chance  of  success  at  high  level  language  processing  is  one  that  can  deal 
with  the  interrelationships  wi thin  text. 

Uhile  we  have  not  yet  come  full  circle,  mechanical  translation  is 


- if  - 1;-m  -t  'irMi-'-B 
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sur racing  again  as  the  name  of  the  problem,  or,  more  properly,  an  the  name  of 
on  problem,  since  language  research  has  diverged  considerably  eince  the 
inception  of  research  on  hT.  Avowed  translation  work  is  underway  at  the 
linivereity  of  T^xarj  at  Auetin,  the  University  of  California  at  Berkeley  (3), 
at  Montreal,  and  at  Stanford  (Wilks,  37).  At  lea.'  one  company,  Logoe 
Development,  is  marketing  an  MT  eystem  for  English  to  Rueeian,  among  other 
‘anguages.  The  system  relies  on  posteditors  with  a knowledge  of  the  source 
language,  but  the  company  claims  a high  rate  of  accuracy  before  poetedi  tting. 
i could  not  get  any  detailed  information  .out  eemantic  proceesing  done  in  tha 
Logos  II!  system,  but  from  examining  the  company's  literature,  I get  the 
impression  that  some  eort  of  semantic  type-checking  is  uoed. 

1.3  A Sample  Text 

Assuming  that  the  teet  of  a translating  aye 'em  is  not  ite  ability  to 
handle  isolated  sentences,  but  rather  its  ability  to  deal  uith  connected  text, 
I selected  a paragraph  from  a pape"  by  Hempelmann  on  octopuses  (17).  Thu  text 
uas  used  as  a goal  for  the  ayetem,  and  I have  tried  to  handle,  in  ao  general  e 
way  as  possible,  Lie  types  of  difficulties  that  the  paragraph  presents' 
Choosing  texts  seemed  much  more  deeirable  than  writing  them,  since  conecioueiy 
manufactured  examples  often  have  an  unnatural  sound,  while  the  moet  innocent- 
looking sample  of  "found"  text  will  usually  contain  a numoer  of  subtle 
difficulties.  The  full  paragrap  is  presented  and  diecueeed  below,  but  let  me 
firet  display  the  accomplishment,  of  the  translate  - system. 

Ein  ‘sutiich  sichtbares  Zsichsn  fOr  die  im  Nervine1  nom  verlaufenden 

Erregungen  iet  das  Spiel  der  Chroma tophoren  der  Cep.  alopoden. 
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A clearly  visible  indication  of  the  excitation?  that  run  through  the 
nervous  systse  is  the  f'ay  of  the  chroMtophores  of  the  cephalopod. 

The  skeptical  Mill  say  that  this  is  not  a vary  Imposing  output,  but  let  me 
remark  that  a major  factor  liaiting  the  output  of  the  system  Is  the  very 
constrained  scope  of  the  English  dictionary.  Although  aany  I sport  ant  probleae 
still  do  reaaln,  it  would  taka  only  a rslatively  aaall  aaount  of  routine  work 
to  increase  the  output  of  the  systea  considerably.  I should  mention  here 
again  that  this  translation  was  produced  without  a component  to  do 
understanding,  so  that  disambiguation  of  word  senses  and  marking  instances  of 
coreference  was  done  by  the  user.  This  understanding  by-pass  u s not  .lone  for 
the  sake  of  exhibiting  translation  without  understanding,  but  rather,  it  uas 
in  the  interest  of  getting  an  ou'out  from  a partial  systea. 

Let  us  look  at  the  full  text  considered,  and  discuss  soae  of  the  problems 
that  a mechanical  translation  systea  would  have  to  face.  Here  is  the  German 
text,  and  following  it  is  ay  own  (hand)  translation. 

(1)  Eiu  deutlich  sichtbares  Zeichen  fOr  die  ia  Nervensystea 
verlaufenden  Erregungen  ist  das  Spisl  der  Chroma tophoren 
der  Csphalopodsn,  jsner  unter  dsr  Haut  liegenden  gelb, 
braun,  schwarz,  violstt  Oder  karainrot  gefftrbten  Zellen, 

(5)  die  sich  entwsder  zusaaaenziehen  Oder  durch  radiSt 
S'isetzende  Muskeln  fOchenhaft  ausgebreitat  warden 
k&nnen.  Hit  ihrer  Hilfe  vermBgen  sich  die  Tiere  bis 
zu  einea  gewissen  Grade  dsr  Farbe  des  Untergrundes 
anzupassen.  Die  das  Chroaatophorsnspiel  vsranlassenden 
(10)  Reize  warden  nicht  nur  durch  die  Augen,  sondsrn  auch 
durch  disse  Farbzellen  sslbst  aufgenoaaen.  So  warden 
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Kraken  bei  pifitziicher  Zunabae  der  lichtintensi t8t 
ganz  dunkei,  auch  wenn  sis  gebiendet  elnd.  Anderereeits 
hfingt  der  Zustand  der  Ballung  Oder  Ausdehnung  der 
(15)  Chroma tophoren  auch  von  den  Saugnfipfen  ab.  Uenn 
diese  nicht  greifen,  so  aind  ie  ailgeeainen  die 
Chroaatophoren  in  Rubes  uenn  oie  aber  saugen,  eo 
spieien  jane.  Seibst  die  Oberf ISchenbeschaf fenhei t 
dee  Untergrundes  Obt,  je  nachdea,  ob  sie  glatt  Oder 
(20)  rauh  ist,  eine  verschiedene  Uirkung  auf  die 

Chroma \ophoren  aus.  Eine  Eledone,  deren  sSatiiche 
SaugnSpfe  entfernt  worden  oind,  bleibt  stfindig 
gelograu,  fSrbt  sich  auf  Reizung  aber  noch  dunkei 
(Cteinach).  Hit  dea  durch  Lichtreiz  hervorgerufenen 
(25)  Chromate  horenspiel  pftegen  Beuegungen  der  Arme 
einherzugehen,  uas  sich  besonders  schfin  an  Sepia 
beobachten  Ifisst.  Auch  der  Trichter  pfiegt  dabei  Uaseer 
auszuspri tzen.  Ob  die  Cephaiopoden  eelbst  auf  Farben 
reagieren,  ist  nicht  bekannt.  Nach  von  Hees  eoiien  sie 
(30)  sich  uie  der  farbenbl in^e  Henoch  verbal  ten.  Da  aber 
manche  in  der  Tiefsee  lebenden  Tintenfische  in 
verschiedenen  bunten  Farben  erstrahiende  Leuchtorgane 
besitzen,  von  denen  man  anniammt.  dass  sie  zua 
gegensei tigen  Sichauf f inden  der  Gesch lech ter  dienen,  eo 
(35)  scheint  das  zum  mindesten  fOr  diese  Foraen  fOr  einen 
Far bens  inn  zu  sprechen.  Eingehende 
Untersuchungen  fiber  einen  etuaigen  Farb^-usinn  der 
Cephaiopoden  sind  sehr  erufinscht.  Neuerdings  hat 
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Frflhlich  Unterschiede  in  den  von  Auge  abgeleiteten 
(40)  Aktionsstrfimen  auf  verechiedene  Farbrelze  fsetgeetel  1 1, 
was  ebenfalle  eehr  dafOr  epricht,  daee  dieee  Here 
Farben  zu  unterecheiden  vern&gen. 


A clearly  vieible  Indication  of  the  excitations  that  run  through  the 
nervous  system  is  the  play  of  the  chroma tcphores  of  the  cephalopod,  thoee 
cells  that  lie  under  the  skin  and  are  colored  yellow,  brown,  black, 
purple,  or  carmine  red.  They  can  contract  theneelver  and,  again,  via 
radially  fastened  muscles,  be  spread  out  under  the  sl.in  surface.  Uith 
their  help,  the  animal  is  able  to  adapt  to  some  degree  to  the  color  of 
its  background.  The  stimuli  that  trigger  the  play  of  the  chroma tophora* 
are  perceived  not  only  through  the  eyes,  but  also  by  the  color  celle 
themselves.  So  It  Is  that  cephalopoda  become  quite  dark  in  response  to  a 
sudden  increase  in  light  Intensity,  even  when  they  have  been  blinded.  On 
the  other  hand,  the  state  of  contraction  or  relaxation  of  the 
chromatophores  is  also  dependent  on  the  suckers.  Uhen  these  are  not 
grasping,  the  chromatophores  are  generally  at  rests  uhen  they  adhere  to 
something,  houever,  then  the  chromatophores  begin  to  play.  Even  the 
nature  of  the  bottom,  whether  it  is  smooth  or  rough,  has  a certain 
influence  on  the  chromatophores.  An  eledone  whose  suckers  have  all  been 
removed  remains  a yellowish  gray,  although  it  will  still  go  dark  if  given 
a stimulus  (Steinach).  Along  with  the  play  of  chromatophores  elicited  by 
light  stimulus,  there  are  generally  movements  of  the  arms,  which  are 
particularly  easy  to  observe  In  Sepia.  At  the  same  time,  the  ambulatory 
funnel  usually  squirts  out  water.  Whether  the  cephalopode  even  react  to 
color  is  not  known.  According  to  von  Hess,  their  behavior  le  like  that 
of  a color-blind  man.  But  since  ma^y  deepsea  dwelling  cephalopoda 
possess  light  organs  that  shine  in  various  bright  colors,  and  since  one 
assumes  these  serve  the  purpose  of  helping  the  sexes  find  each  other, 
then  for  at  least  these  forms  one  would  be  inclined  to  assume  a sense  of 
color.  Thorough  investigations  on  the  existence  of  a sense  of  color  in 
cephalopoda  would  be  very  desirable.  Recently,  Frflhlich  was  able  to 
distinguish  differences  in  the  neural  impulses  sent  out  by  the  eye  when 
given  different  colored  stimuli,  which  again  very  strongly  suggests  that 
these  animals  are  able  to  distinguish  colors. 


The  choices  that  had  to  be  made  in  producing  the  translation  will  be  diecueeed 
in  more  detail  in  the  chapters  that  follow,  but  a cursory  look  at  the  text 
reveals  the  following  sorts  of  problems: 

(a)  SYNTACTIC  AMBIGUITY:  Choice  of  a parse  can  have  rather  etrlking 
influence  on  a translation.  For  example,  line  28  and  29  can  be  parsed  in  two 
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waysi 

Ob  (die  Cephaiopoden)  eeibst  auf  Farben  raagieran... 

Uhather  (the  cephalopoda)  even  react  to  color  ... 

Ob  (die  Cephaiopoden  eelbet)  auf  Farben  reagleren. .. 

Uhether  (the  cepaphaiopode  themselves)  react  to 
co I or  .... 

(b)  PRONOUN  REFERENCES  are  quite  coaaon  In  the  paragraph.  In  line  7,  to 
what  doee  ihrer  refer?  The  muscles?  The  chroeatophoree?  It  le  our 
understanding  of  the  preceding  eentence,  rather  than  some  hard  and  faet  rule, 
that  determines  a choice  here.  The  phenomenon  of  pronoun  reference  ie  not 
only  limited  to  pereonal  pronouns,  but  includes  relative  pronouns  such  as 
denen  in  line  33,  and  demonstrative  adjectives  used  as  pronouns  such  as  diese 
and  iene  in  lines  16  and  18.  In  addition,  compounds  like  dabai  and  dafOr  may 
be  used  to  refer  backward  (line  27)  or  to  refer  forward  (line  41). 

Going  from  German  to  English,  we  can  often  get  away  with  translating  an 
ambiguous  pronoun  reference  with  an  equaiiy  ambiguous  English  pronoun.  Uhen  a 
sentence  nsede  considerable  rearranging,  however,  this  will  not  always  work. 
For  example,  we  may  have  to  put  in  a noun  group  where  ths  original  had  a 
pronoun.  Note  also  that  the  iimitsd  success  of  this  approach  is  partly  a by- 
product of  the  language  pairs  choean.  Going  from  English  into  German,  where 
gender  agreement  is  necessary  between  pronoun  and  referrent,  a definite  choice 
of  pronoun  refsrrsnt  would  be  forced  mors  often  than  when  the  direction  of 
translation  is  from  German  Into  English.  So  while  a decision  about  pronoun 
reference  will  not  be  forced  in  every  case,  a translating  eystem  must  be 
equipped  to  make  the  decision  uhen  necessary. 

(c)  As  if  pronouns  a<  a not  enough,  we  also  have  a series  of  NOUN 
REFERENCES.  Lins  7 usss  "dls  Tiere*  to  refer  back  to  the  cephclopods  of  line 
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3,  and  it  requires  an  understanding  of  the  paragraph  to  determine  that  the  tuo 
noun  groups  are  preferential.  If  the  noun  groups  are  coreferent i at,  we  can 
translate  "die  Tiers"  simply  at  "the  animals"  (or,  as  "tha  animal,"  el  nee  this 
sounds  more  natural  In  English).  If,  on  the  other  hand,  "die  Here"  refers  to 
animals  in  general,  than  ths  English  would  have  to  be  just  "animals." 

(d)  CHANGES  OF  TOPIC:  Taking  the  sentence  starting  ulth  "elns  Eledone"  on 

line  21,  and  reading  the  main  clause  of  the  next  sentence,  it  Is  not  specified 
uhoee  chroma tophores  and  arms  ms  ars  talking  about  - the  eledone' e or  those  of 
any  cephalopod.  There  ars  clues,  but  we  have  to  understand  tha  context  to 
find  them.  Probably  the  easiest  way  to  decide  Is  to  uss  the  Information  In 
the  subordinate  clause:  we  can  reason  that  sepia  is  a subclass  of  cephalopods, 
but  not  of  eledonee,  so  the  discussion  must  psrtaln  to  csphalopods  In  general. 
As  in  (b)  and  (c)  above,  a translation  can  usually  get  by  without  keeping 
track  of  changes  of  topic.  But  situations  will  come  up  in  uhlch  we  have  to 
make  something  explicit  that  was  left  implicit  in  the  original,  and,  for  this, 
knowing  the  topic  could  be  crucial. 

(e)  Another  very  difficult  area  is  UORO  CHOICE.  The  paragraph  here  is  a 
mixture  of  technical  and  common  language.  In  general,  the  more  common  the 
word,  the  more  varied  its  uses.  For  example,  lo  translate  the  word  Farbe  from 
line  8 the  dictionary  (28)  says  we  must  choose  between: 

1.  color,  tint,  hue 

2.  stain,  paint,  dye 

3.  complexion 

Therefore,  even  if  we  know  enough  to  untangle,  say,  pronoun  and  noun 
reference,  we  still  have  to  know  more:  there  ars  fine  distinctions  between 

different  words,  differences  of  connotation  bstween  synonyms,  and  Issues  of 


what  words  combine  best  with  what  other  words. 


18 


Note  that  technical  language  la  often  quite  a bit  easier  to  work  with  In 
teres  of  word  choice,  since  the  aeanings  tend  to  be  careful  ly  circuaecribed 
and  usages  are  Halted.  This  aight  lead  one  to  think  that  a highly  technical 
teat  uould  be  e uhiz  for  a eechanical  translator.  Coapared  to  poetry,  of 
course.  It  would  be.  Nevertheless,  even  the  aost  technical  writing  cannot 
avoid  prepositions,  and  prepositions  (or  their  equivalent  syntactic 
structures)  are  probably  the  aost  aablguous  words  In  any  language.  Uord 
choice,  therefore,  is  a problea  that  Is  always  with  us. 

Uhat  these  five  probleas  - (a)  through  (e)  - have  in  coasicn  is  that  they 
are  unified  probieas  in  naae  only}  each  particular  situation  presents  its  own 
difficulties  and  requires  its  own  unique  solution.  This,  In  the  end,  is  uhat 
aakes  language  processing  so  difficult.  The  best  that  a seal  I scale  research 
project  can  do  is  to  exaaine  a saapling  of  probleas,  with  the  hope  that 
slailar  techniques  can  be  used  to  deal  with  the  various  other  cases  that 
occur. 


1.4  Uaitaimns 

Before  beginning  in  earnest.  It  aighi  be  a good  idea  to  sketch  out  the 
boundaries  of  the  project.  Soae  areas  could  have  been  Incorporated  into  the 
project  given  aore  tiae,  while  soae  are  aajor  probleas  in  their  own  right.  So 
here  is  a list  of  uhat  the  systea  is  noti 

(a)  The  project  was  liaited  to  written  text  and  not  speech.  Thus,  probieae 
like  intonation,  fixing  word  boundaries,  and  vocal  differences  between 
speakers  did  net  have  to  bs  touched. 

(b)  Also,  input  was  assuasd  to  be  grsaaatical ly  well-foraedt  no  atteapt  was 
aade  to  extract  a aessage  froa  a fora  that  was  not  fully-defined  for  the 
systea.  Readers  Interested  In  the  probleas  of  handling  ungraaaatical  text  are 
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referred  to  Levine  (21),  Mho  has  developed  a program  for  grading  German 
sentences  in  a classroom  situation. 

(c)  No  understanding  of  the  text  is  attempted,  l’hie  ie  because  the  problems 
of  representing  i;nouledge  and  using  thie  knouledge  for  disambiguation  are 
extremely  complex.  A considerable  amount  of  research  is  underway  in  thie 
area,  and  whatever  results  appsar  in  the  field  of  natural  language 
understanding  will  have  direct  relev?  ice  for  translation.  The  German 
interpretive  grammar  in  the  system  ie  connected  to  the  English  generator  via 
an  understanding  by-pass  routine  th at  requires  human  intercession.  Thie  ie 
intended  for  demonstration  purposes  only. 

(d)  The  system  is  a very  poor  conversational  ist.  The  German  grammar,  which 
is  the  most  complete  component  in  the  system,  is  prepared  to  parse  questions 
and  commands,  but  the  rest  of  the  system  is  geared  strictly  for  declarative 
text.  This  limitation  ie  the  result  of  time  constraints,  but  aleo  reflects 
the  focue  of  the  project  on  connected  written  text. 

The  reader  by  now  has  ari  idea  of  what  the  eyetem  dose  not  do,  and  the 
following  pages  will  hopefully  make  it  clear  not  only  what  the  eyetem  does, 
but  how  it  goes  about  doing  it.  1 have  tried  to  give  English  equivalents  for 
German  examples,  so  that  a knowledgs  of  Gsrman  should  not  be  necessary. 
Familiarity  with  Ui nograd' e system  (39)  and  LISP,  however,  would  be  useful. 

1.5  Organisation  of  the  System 

The  implementation  was  written  in  MAC-LISP  and  rune  on  the  POP-18 
Incompatible  Time-Sharing  System  at  H. I.T's  Project  MAC.  The  translator  has 
six  major  components,  whose  functions  are  outlined  below.  It  currently 
occupies  about  188K  of  core,  which  includes  the  LISP  interpreter.  The  eyetem 
has  only  been  run  interpret'! vely,  but  could  be  compiled.  The  major  components 
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The  GERMAN  DICTIONARY,  which  contain*  eyntactic  and  aaaantic  information  for 
the  approximately  2S0  geraan  uorde  currently  defined  in  the  system. 

The  morphology  routine  called  INPUT  it  the  first  past  in  processing  a text. 
Given  a sentence,  the  input  routine  anaiyzss  each  uord  into  its  root  and 
endings,  then  usee  the  dictionary  to  construct  possible  syntactic  feature 
lists  for  the  combination.  This  syntactic  information,  along  uiih  semantics 
picked  up  from  the  dictionary  definition,  is  then  associated  with  the  sentence 
uord. 

The  GERMAN  GRAMMAR  ie  written  in  PROGRAMMAR,  a USP-embedded  ianguaye  designed 
as  a grammar-writing  tool  (Ui nograd  38).  The  grammar  routines  use  the  result 
of  INPUT  to  construct  a single  paree  tree  of  the  sentence.  To  do  thie,  the 
grammar  interacts  with  the  semantic  component  in  an  attempt  to  limit  syntactic 
ambiguities  by  the  limited  semantic  case  checking  currently  implemented. 

Uhere  a syntactic  ambiguity  cannot  be  eliminated  immediateiy,  a choice  ie  made 
and  backup  is  used  if  necessary. 

Uhen  the  grammar  has  parsed  a section  of  the  sentence,  it  caiie  the  SEMANTIC 
COMPONENT  for  initial  semantic  processing.  Semantics  construct*  as  many 
representations  as  poesibie.  If  this  number  is  zero,  syntax  is  asked  to 
reparse  the  section,  if  the  number  is  non-null,  aii  possible  interpretations 
are  carried  forward.  These  semantic  ambiguities  Mi  I i be  eliminated  iater  in 
the  sentence  either  by  the  semantic  component  or  by  user  intervention,  eo  that 
only  a eingie  reprssentatiqn  is  sent  to  the  generator. 
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Associated  with  ths  semantic  structure  are  the  routines  of  the  ENGLISH 
DICTIONARY  which,  when  executed,  supply  a set  of  relevant  English  words. 

Using  these  words  along  with  other  inforeation  available  froe  the  semantic 
representation,  thi  ENGLISH  GENERATOR  can  then  construct  an  English  equivalent 
for  the  input  sentence.  Output  is  not  necessarily  sentence  for  sentence, 
since  the  translator  does  have  a Halted  facility  for  breaking  down  long 
German  sentences  into  two  or  more  short  English  ones. 

me* 

The  sections  that  follow  deal  with  the  system  in  approximately  this 
order,  with  the  exception  that  information  about  the  dictionaries  is 
distributed  throughout  as  it  becomes  relevant.  Chapters  2,  4,  and  6 discuss 
the  sections  of  the  model  that  have  bsen  implemented,  and  chapters  3 and  5 
discuss  some  issues  in  representing  knowledge  and  understanding  natural 
language. 
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Chapter  2 — The  Gerean  Interpretive  Grammar 
2.1  The  Underlying  Theory 

The  analysis  of  German  Has  based  on  the  theory  of  systemic  grammar 
developed  by  tl.A.K.  Ha  1 1 i day  (10-16).  Some  of  Hall i day's  ideas  on  diecourem 
have  also  been  used,  but  discussion  of  this  ie  deferred  to  section  4.9.  In 
describing  systemic  grammar,  I must  necessarily  be  brief,  and  the  reader  who 
uants  an  in-depth  treatment  is  referred  toHalliday,  Hudson  (20),  and  Uinograd 
(39). 

The  central  precept  of  Halliday's  theory  is  that  language  ie  structured 
to  convey  meaning.  That  ie,  any  analysis  of  language  cannot,  and  should  not, 
divorce  fora  from  this  eingle,  overriding  function.  The  job  of  conveying 
meaning  is  delegated  among  different  syntactic  units,  of  uhich  there  are  three 
ranks!  clause.  arouL.  and  Hord.  At  tha  group  level,  there  are  noun  groupe, 
preposition  groups,  and  adjective  groups  (I  follou  Hudson  here  in  exiling  the 
verb  groups  see  section  2.6.1).  The  mechanism  of  rankshift  permits  one  unit 
to  assume  the  role  of  another,  for  example,  a clause  may  take  the  place  of  a 
noun  group.  Associated  with  each  unit  is  a netuork  of  features,  uith  a set  of 
mutually  exclusive  features  knoun  as  a sustem.  These  netuorks  specify  the 
choices  available  in  the  language.  Ue  move  from  one  level  to  another  in  the 
netuork  by  satisfying  the  entru  cond i t i on  of  a system.  Each  choice  made  aay 
set  up  certain  constraints  on  the  surface  structure  of  an  utterance  by  means 
of  real  ization  rules  associated  uith  it.  For  example,  the  decision  to  put  an 
adverbial  (a  preposition  group  or  an  adjective  groun)  in  the  first  position  of 
the  sentence  in  German  means  that  sjbject  and  finite  (i.e.  conjugated)  verb 
Mill  have  inverted  order.  An  important  point  about  Halliday'e  theory  ie  that 
the  choices  at  a given  stage  are  not  ordered  uith  respect  to  each  other. 
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Uni  ike  trans forest i one i grammar,  mb  are  not  deriving  one  fui iy-epecif  ied 
etructure  from  another.  Instead,  as  Me  proceed  through  the  networks  ue 
accumulate  partial  information,  until  in  the  end  the  eurface  etructure  of  an 
utterance  is  fuiiy  specified. 

A network  for  the  German  clauses  bandied  in  the  system  appears  in  Figure 
2.2,  along  with  example  sentences.  I have  tried  to  keep  the  presentation 
close  to  that  of  Uinograd,  so  that  a reader  familiar  with  his  English  charts 
should  have  no  difficulty  here.  The  notation  used  in  the  network  is  shown  in 
Figure  2.1.  In  Figure  2.1a,  the  verticai  line  indicates  a system,  and  the 


LABEL 


a) 


b) 


c) 


Figure  2.1 


horizontal  line  on  the  left  specifies  an  entry  condition.  The  system  may  be 
labeled,  as  it  is  here,  by  writing  the  label  above  the  entry  condition.  If 
two  independent  systems  share  the  same  entry  condition,  this  is  indicated  as 
in  Figure  2.1b.  If  there  is  mors  than  one  entry  condition  associated  with  a 
given  system,  it  may  only  be  necessary  to  satisfy  one  of  them  (Fig.  2.1c). 
Features  indicated  by  a dashes  ( — ) are  unmarked,  and  are  defined  merely  ae 
the  absence  of  the  Other  features  in  the  system. 


25 


CLAUSE- 


MAJOR — 


SEC- 


ADJUNCT 


IMPERATIVE 

H REGULAR-ORDER  ID 
INVERTED-ORDER  (2) 

QUESTION 


BOUND  (3) 

ZU-AJNCT  (4) 

PRESP  (5) 

PASTP  (S) 

OASS  (7) 

DEL-DASS  (8) 
ZU-RSQ  (9) 

REL  (10) 

PASTP  (11) 
PRESP  (12) 


RSQ- 


RSNG 


PRENOM 


If 

If 


C 

T 

|[ 


OASS  (13) 

REPORT- 

' DEL-DASS  (14) 
ZU-RSNG  (15) 

SUBJ 

OBJ 


Numbers  in  parentheeee  refer  to  example  eentencee  on  the  following  page. 


Figure  2.2 
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The  foliowing  example  sentence*  correspond  to  the  numbered  featuree  on  the 
previous  page.  The  translations  attempt  to  give  • rough  idea  of  the 
etructures  involved. 

(1)  Ein  Sem  i -ko I on  gendgt. 

A semi-colon  suffices. 

(2)  Oft,  genOgt  ein  Semi-koion. 

Often,  suffices  a semi-colon. 

(3)  Sie  wOrden  eingentlich  nur  auffailen,  uenn  si  a 
ausfal len. 

They  would  actually  only  be  noticed,  uhen  theu  fare 
missing. 

(A)  Ufl  den  Hund  jy  retten.  stQrzte  sich  der  Bauer  ine 
Uasser. 

Ifl  save  the  dog,  the  far'  ar  plunged  into  the  uater. 

(5)  Al te  L i eder  ainaend.  kamen  die  Kinder  hinein. 

The  chi Idren  came  in  sinoina  old  sonas. 

(6)  Pf  lock  anaebunden.  Schzte  ein  verlaenenes  Boot  in 
Uel lenechldge. 

Bound  1ft  a Dost,  an  abandoned  boat  groaned  in  the  wavee. 

(7)  Eben  bekommen  uir  die  Nachricht,  dass  der  Zilft  noch 
nich*  abaefahren  sei. 

Ue  have  just  recieved  news  that  the  train  has  not  left 
uet. 

(8)  Eben  bekommen  uir  die  Nachricht,  ftac.  £us  sei  noch  nicht 
abaefahren. 

Ue  have  juot  recieved  neus  ihfi  train  has  oai  left  yet. 

(9)  Ich  hatte  ale  Gelegenheit,  Ber I in  zy  besuchen. 

I had  the  opportunity  la  visit  Ber I in. 

(10)  Eine  El  done,  deren  gawt I i Chg  Sauan8bfe  entfernt  warden 
s.t  nde  • • • 

All  eledone,  all  fti  HfaSM  BUfeKorg  toft  been  removed.  ... 

(11)  flit  dem  durch  Lifthicaia  herYorflflrufenBn 
Chroma tophorenspiei  ... 

Along  uith  the  by  I iaht  stimulus  el  ici  ted  play  of  the 
chromatophores  . . . 

(1?)  Ein  deutlich  sichtbares  Zeichen  fflr  die  im  Nervensustem 
ver laufenden  Erregungen  ... 

A clearly  visible  indication  of  the  through  the  nervous 
sustem  running  excitations  ... 

(13)  Ich  nehme  an,  dass  s i e schon  fort  Bind. 

I assume  that  theu  are  a I ready  gone. 

(14)  Ich  nehme  an,  fljja  sind  schon  fort. 

I aseume  theu  arp  alreadu  cone. 

(15)  Ich  bitte  d!  h,  ffij.ch  BflCflfiQ  2 U besuchen. 

I request  you  1ft  mil  BA  tomorrow. 
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2.2  A Definition  for  Syntax 

Distinguishing  syntax  fro*  semantics  is  a slippery  business,  especially 
uhen  1 have  just  claimed  to  subscribe  to  the  idea  that  the  structure  of  an 
utterance  is  intinately  entwined  with  the  meaning  it  conveys.  Still,  there 
seems  to  be  some  life  left  in  this  very  old  distinction,  so  let  me  make  an 
attempt  to  delimit  a useful  boundary.  Traditionally,  syntax  has  dealt  with 
the  form  of  language  and  semantics  with  its  content,  or  meaning.  Thie 
definition  is  a start,  but  it  is  too  much  of  a simplification,  since  it 
ignores  the  effects  that  semantic  content  can  have  on  form.  In  German,  for 
example,  the  default  adverbial  ordering  is  time  before  manner  before  place. 
Here,  time,  manner  and  place  iook  like  semantic  categories,  but  their  presence 
hae  a direct  effect  on  the  surface  structure  of  the  utterance. 

The  whole  situation  becomes  even  more  complex  uhen  one  considers  that 
most  choices  about  the  fora  of  an  utterance  have  what  are,  in  terms  of  the 
traditional  definition,  semantic  implications.  It  is  true  that  there  are 
choices  that  seem  to  be  motivated  by  syntactic  rules  alone,  such  as  the  fact 
that  the  preposition  ohnfl  takes  the  accusative  case  in  German,  while  one  like 
bw-1  takes  the  dative.  (Here,  and  in  what  follows,  I am  using  "rule"  in  the 
broad  sense,  to  mean  a regularity  in  language.)  More  common,  however,  ie  a 
situation  such  as  plural  formation.  In  German,  there  are  several  ways  to  form 
the  plural  for  nouns,  with  different  nouns  taking  -en,  -e,  -"e,  -"er,  er, 
etc.  The  choice  between  endings  is  a syntactic  or  morphological  one  (although 
many  words  are  fairly  idiosyncratic),  Uit  at  the  same  time,  the  addition  of  a 
olural  ending  reflects  a distinction  between  one  and  more  than  one  that  ie 
basically  semantic,  in  the  traditional  sense. 

To  firm  up  our  definition,  one  way  to  go  from  here  would  be  to  identify 
the  syntactic  aspect  of  language  with  rules  that  govern  sentence  formation  and 
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say  that  semantics  is  the  great  Morass  beyond.  This  definition  bege  the 
question,  however,  since  the  content  of  language  May  be  just  as  rule-governed 
as  ite  fora.  For  example,  there  Might  be  a rule  to  express  the  fact  that  "The 
blue  horse  is  blue"  Is  redundant,  or  the  fact  that  "The  blue  horae  ie  green" 
is  contradictory.  To  call  such  phenoaena  syntactic  because  they  are  rule- 
governed  is  fines  the  only  trouble  Is,  houever,  that  then  it  is  not  clear 
uhat,  if  anything,  is  left  for  seMantics. 

In  building  the  systeM,  ay  decision  whether  a given  aspect  of  language 
was  syntactic  or  semantic  uas  based  on  the  following  definition  for  syntax. 
Syntactic  rules  give: 

(i)  a ainiaal  specification  of  word  order 

(ii)  a specification  of  the  morphemic  and  lexical  tags  that  explicitly 
mark  the  relationships  between  words  and  the  relatione  within  and  between 
syntactic  structures 

(iii)  a specification  of  punctuation 

All  the  rest  goes  into  semantics.  (I  aa  ignoring  the  semantic/pragaatiC 
distinction,  since  I find  it  even  More  difficult  to  draw  than  the 
syntactic/semantic  one.)  Note  that  English  syntactic  rules  rely  very  heavily 
on  word  urder,  while  German  strikes  More  of  a balance  between  word  order  and 
morphology  (i.e.  case  distinctions).  Uith  more  reliance  on  explicit  tags  for 
its  syntactic  distinctions,  German  has  a concomitantly  higher  degree  of  word 
order  flexibility  than  does  English.  Uith  respect  to  (i),  the  definition  of 
minimal  can  really  only  be  g’ven  in  the  form  of  a list  of  eyntactic  ruiee. 

The  closest  thing  I have  to  this  now  is  the  set  of  word  order  constrainte 
built  into  the  interpretive  end  generative  grammars,  but  of  course  theee  are 
not  complete.  To  give  you  an  idea  of  whet  I have  in  alnd  for  (i),  I would 
consider  something  like  verb  ordering  In  end-order  a syntactic  rule.  On  the 
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other  hand,  such  things  as  adverbial  ordering  (mentioned  above)  and  adjective 
ordering  before  a noun  ("the  big  red  block"  as  opposed  to  "the  red  big 
block")  are  orderings  beyond  the  minimal,  and  are  based  on  semantic  criteria. 
Relating  thie  definition  of  syntax  to  the  networks  of  systemic  grammar,  I 
would  call  a feature  syntactic  if  its  associated  realization  ruiee  ali  fall 
into  the  three  categories  given  above. 

1 realize  that  the  definition  of  syntax  given  here  ie  a sketchy  one,  but 
it  should  be  enough  to  give  a sense  of  the  criteria  that  were  used  for 
deciding  which  regularities  should  be  reflected  in  the  syntactic  components 
(both  interpretive  and  generative)  and  which  in  the  semantic  component.  I 
should  add  here  that  these  criteria  were  ignored  occasionally  for  the  eake  of 
efficiency,  so  that  the  interpretive  grammar  program  is  far  from  a pure 
linguistic  statement. 


2.3  Uord  Classes 

Uhile  I will  not  diecuss  the  treatment  of  ciaueee  and  groups  in  detail,  1 
would  like  to  look  at  classification  at  the  uord  level.  A description  cr  the 
different  parts  of  speech  used  for  German  words  foiloue,  while  a summary  of 
the  features  used  in  definitions  can  be  found  in  Appendix  A. 

2.3.1  Adjectives  and  Adverbs 

A distinction  between  adjectives  and  adverbs  ie  especially  difficult  to 
draw  in  German.  Uhere  in  English  we  have  "Fido  sings  well"  and  "Fido  ie 
good. " the  equivalent  in  German  is  "Fido  eingt  out"  and  "Fido  iet  gut. " To 
get  an  idea  of  where  the  distinction  between  adjectives  and  adverbs  ie  to  be 
drawn  - or  whether  such  a distinction  even  should  be  drawn  - we  need  to  know 
the  functions  that  these  units  will  have.  Five  likely-looking  functions  would 
be: 
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(1)  attribute  of  a noun  (declined),  as  in  "der  blaue  Engel*  • "the  biue 

angel" 

(2)  complement,  ae  in  "Die  Eledone  iet  k!uo"  - "The  eledone  ie  emart" 

(3)  postnominal  modifier,  ae  in  "die  Straeee  I inks"  - "the  street  on  the 

left 

(4)  modifier  of  a verb,  ae  in  "Er  fShrt  echne 1 1 " - "He  drives  fast" 

(5)  modifier  of  the  modifier  types  (1)  through  (5),  as  in  "sine  lfihc. 

gute  Gelegenheit”  - "a  very  good  opportunity" 

Especially  uhen  dealing  uith  German,  it  may  be  better  to  have  a single 
adjective-adverb  category  colled  "modifiers"  and  avoid  the  problem  of  uhere  to 
dr-au  the  line.  A highly  conservative  line,  houever,  uas  drawn  for  the  system. 
Basically,  an  adverb  is  a member  of  the  class  that  performs  function  (5) 
above,  but  there  are  eeveral  conditions  that  further  constrain  adverb 
membership. 

One  criterion  for  an  adverb  that  will  be  used  is  that  it  may  never  take 
adjective  endings,  that  is,  psrform  function  (1).  Further,  an  adverb  may 
never  have  a comparative  or  superlative  form.  Both  criteria  must  be  present 
at  once,  since  eome  perfectly  good  words  that  take  attributive  endinge  do  not 
have  comparative  or  euperlative  forme,  and  there  are  uorde  that  can  perform 
both  functions  (1)  and  (5).  An  example  of  the  latter  ie  deutl  ich  in  "ein 
deutlich  eichtbaree  Zsichen"  ("a  clearly  visible  Indication")  and  "ein 
deutlicher  Satz"  ("a  meaningful  sentence").  Candidates  for  adverb,  then,  are 
uorde  I ike  afi*  sehr.  24,  and  a feu  others. 

It  must  be  obvious  at  thie  point  that  adverbs  are  a rather  select  group, 
and  that  the  class  "adjective"  covers  a iot  of  ground,  fo  alleviate  this 
problem,  the  eyciem  uses  features  that  correspond  to  the  functions  given 
above.  Adjectives  are  either  AfTR  (attributive,  function  1),  COflPL 
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(complement,  function  2),  POSTNOM  (postnominal,  function  3),  or  RELMOO 
(relation  modifiers,  functions  4 and  5).  Some  RELMOO  adjectives  may  take  an 
object  as  a verb  does,  for  example,  "Das  ist  nicht  dflL  Mflhe  wart"  ("That’s  not 
worth  the  effort").  If  this  is  possible,  then  the  case  of  the  object  must  be 
specified  in  the  feature  list  of  the  RELMOO  adjective. 

ATTRibutive  adjectives  are  DECLined,  which  means  that  they  take  endings, 
which  are  specified  for  case,  gender  and  number  of  the  main  noun  in  the  noun 
group.  Adjectives  are  also  said  to  have  a STRONG,  UEAK,  or  MIXEO  declension, 
depending  on  the  determiner  in  the  noun  group.  STRONG  adjective  endings  are 
used  when  an  adjective  Is  in  first  position  in  the  noun  group,  for  example, 
"gutfiL  Uein"  ("good  wine")  or  uncr*  the  adjective  parallels  another  strongly 
declined  adjective  ("feiner,  lebhafter  Uein"  / "fine,  lively  wine").  UEAK 
endings  appear  on  adjectives  following  any  determiner  with  strong  endings 
("der  gutfi.  Uein"  / "the  good  wine"),  and  MIXED  endings  follow  indefinite 
determiners,  since  these  may  or  may  not  carry  case  and  gender  information: 
"einen  gu ten  Uein"  (accusative),  but  "ein  gutftt.  Uein*  (nominative). 

I should  note  that  calling  words  that  fulfill  fuctions  (1),  (2),  and  (4) 
adjectives  is  in  agreement  with  the  analysis  of  Gllnz  (8),  although  ay  adverb 
category  is  more  tightly  constrained  than  his. 

2.3.2  Binders 

Examples  of  the  class  BINDER  ars  dass.  nachdem.  sei t.  wenn.  etc.  Binders 
appear  in  the  first  place  of  a subordinate  clause.  Uenn/dann  combinations 
(the  equivalent  of  if/then)  are  not  handled  in  the  grammar,  but  they  would 
need  a special  tag  in  the  dictionary. 

2.3.3  Cardinals 

Cardinals  (NUT),  like  zwe i . drei . etc.,  occur  in  noun  groups,  and  right 
now  the  parser  assumes  that  they  will  not  be  declined. 
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2.3.4  Cor  unctions 

The  coordinating  conjunctions  - und.  aber . Oder,  sondern  and  denn  - are 
not  given  syntactic  features,  but  instead  are  defined  using  a epecial 
function.  In  the  eyetee,  the  parsing  of  conjunctions  ie  done  ueing  a program 
taken  fro*  Ui nograd’s  eystee  with  oniy  elight  aodif ication.  See  Uinograd  (39, 
p.  98  ff.). 

2.3.5  Oeterniinere 

Detereinere  (OET)  are  a fa'*riy  diverse  class,  with  the  common  property 
that  they  can,  and  usually  do,  occupy  the  first  position  in  a noun  group. 

Those  ui  th  the  feature  0EF  - the  definites  der.  die,  das,  dee,  etc.  - carry 
specification  of  gender,  nueber,  and  case  The  indefinites  (INDEF)  ein  and 
kein  are  distinguished  uith  respect  to  number  (SING  or  PLUR)  and  take  endinge 
that  indicate  gender  and  case.  Possessive  detainers  (POSS)  iike  mein,  dein 
and  sein.  specify  person,  gender,  and  nueber  froe  their  associated  pronoune, 
then  take  endings  for  gender,  nueber,  and  case  of  the  aain  noun  in  the  noun 
group.  Determiners  that  take  *der”  endings  are  called  demonstrative 
adjectives  here  (OEHADJ)  and  includs  dies-,  icn-.  etc.  There  are  aieo  the 
interrogative  determiners  (INTER)  uelch-  and  uessen.  Uelch-  is  declined  for 
gender,  number  and  case,  uhiie  uessen  takes  no  endings  and  carries  no  such 
epeci f ication. 

2.3.6  Interjections 

These  uords,  like  aber  and  jfl,  may  appear  betueen  the  subject  and  verb  in 
regular  or  inverted  order  clauses. 

2.3.7  Nouns 

Nouns  may  be  either  MASS,  COUNT,  or  proper  5PR0PN),  uhich  are  relevant  to 
uhether  a determiner  may  be  used.  They  may  be  S.  or  WEAK  depending  on 
uhat  endings  are  taken.  For  STRONG  nouns,  the  piural  and  genitive  .'•dingo  are 


33 


given  in  the  definition.  The  genitive  ending  ie  necessary  here  because  there 
is  not  enough  Morphological  inforaation  in  the  input  routine  to  derive  it. 

To  do  this  reliably,  INPUT  would  ha\e  to  take  into  consideration  the  lumber  of 
eyi  tables  in  the  word  and  the  nature  of  its  terminal  letters. 

2.3.8  Participles 

The  PARTicipie  class  consists  of  past  participles  (PASTP)  - like 
aeschHommen  (shub)  - and  present  participles  (PRESP)  , like  achuineend 
(bh inning) . Participles  are  not  entered  in  the  dictionary  eKplicitly,  but  the 
underlying  verbs  are.  It  is  the  responsibility  of  the  Morphology  program, 
discussed  below,  to  transform  a verb  definition  into  one  for  a participle.  If 
a participle  is  OECLined,  then  it  takes  the  same  endings  as  an  adjective. 

2.3.9  Prepositions 

Happily,  this  is  a simple  part  of  speech  syntactically.  Prepositions 
are  either  pre-fixed  tPREl  as  in  "jyHause,"  or  post-fixed  (POST)  as  in  "dem 
Haus  aeoenOber."  The  cases  they  govern  are  either  dative  (OAT),  accusative 
(ACC),  genitive  (GEN)  or  Mixed  (DIXEO),  i.e.  either  dative  or  accusative. 

2.3.10  Pronouns 

As  in  the  case  of  determiners,  there  ar  3 a number  of  varieties  of 
pronouns  (PRON).  Host  common  are  the  personal  prono»ms  (PERS) , which  ie 
actually  a poor  choice  of  terminology  here,  since  in  German  they  are 
frequently  used  to  rofer  to  inanimate  objects.  Personal  pronouns  are 
specified  for  person,  case,  number  and  gender  (if  third  person).  There  ie 
also  a group  of  personal  pronouns  distinguished  by  the  feature  RELMGO.  REU100 
pronouns  like  was,  and  da  (when  da  Is  compounded  with  a preposition)  may 
refer  to  whole  relations  or  statements  rather  than  just  to  other  noun  groups. 
The  interrogative  pronouns  (INTER)  like  mm  and  yai  are  specified  for  case, 
while  the  possessive  pronouns  (POSS)  - like  meine  - are  marked  with  gender. 
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number,  and  person  of  the  pronoun  part,  t’’*n  end  Inge  indicate  gender,  caee, 
and  number  in  the  pronoun’s  role  In  the  noun  group.  Abstract  pronouns 
(ABSTRACT)  are  those  like  B2T  and  iemand.  The  relative  pronouns  (REL)  - der. 
die,  das,  dercn.  deseen.  welche.  etc.  - look  a lot  like  definite  determinere 
and  carry  gender,  number,  and  fcase  information.  Finally,  OEFinite  and 
INOEFinite  determiners  may  Hso  be  used  as  pronouns,  so  they  carry  the 
features  PRON  DEM  (for  demon.,  . stive  pronoun). 

2.3.11  Quantifiers 

This  class  is  used  for  words  that  appear  in  first  position  of  the  noun 
group  but  can  coexist  with  determiners,  e.g.  "all  ole  Menschen"  ("al I the 
people")  and  "eelbst  eln  Cephalopod"  ("even  a cephalopod"). 

2.3.12  Separable  Prefixes 

In  general,  these  coincide  with  the  class  of  prepositions,  and  their 
usage  corresponds  to  the  English  particle,  as  in  "I’ll  call  them  u£.” 

Separable  prefixes  (SEPPR)  appear  In  the  dictionary  as  separate  words  in  terae 
of  syntactic  features,  but  they  are  not  given  semantic  definitions  independent 
of  their  associated  verb. 

2.3.13  Verbs 

Verbs  come  in  the  following  varieties!  First,  they  are  either  main  verba 
(MVB),  auxiliaries  (AUK),  or  models  (MOOAL).  The  auxiliaries  are  haben.  mein, 
and  werden.  and  modale  are  those  that  require  a main  verb  Infinitive.  Modale 
include  kflnnen.  sol len.  mQssen.  etc. 

If  a verb  is  a MVB,  it  may  be  PLAIN,  -SEPPR  or  +3EPPR.  +SEPPR  means  that 
the  verb  form  happens  to  have  its  separable  prefix  attached  (abhSnoen) . while 
-SEPPR  means  that  the  separable  prefix  Is  somewhere  else  right  now  (hlngt 
davon  at*)  • PLAIN  verbs  are  all  the  rest.  A verb  definition  aleo  specifies 
whether  the  verb  is  regular,  irregular,  mixed,  or  takes  an  umlaut  in  the 
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second  and  third  parson  singular  (REG,  1RR,  MIXED,  and  UML,  raspactlvaly) . 
Veros  uith  inseparable  prefixes,  like  beat tzen.  are  narked  INSEPPR.  This 
Infornatlon  is  for  the  benefit  of  the  sorphology  routine. 

Another  sort  of  infornatlon  is  the  type  of  objecte  that  a verb  nay  take, 
uhich  Mill  detersins  the  transitivity  of  the  clauee.  Instead  of  using 
features  like  TRANSitive,  1 have  specified  transitivity  in  terse  of  syntactic 
case  for  noun  groups  and  other  abbreviatione  for  adverbial  e.  For  exasp  I e,  A+O 
is  the  feature  of  a verb  that  takes  an  accusative  and  a dative  object  (not 
neceeearily  in  this  order).  If  a preposition  is  required  by  the  verb,  then 
its  transitivity  is  given  ae  "P",  uhile  if  any  adverbial  ie  required,  "E*  is 
used  (for  no  particular  reason:  "A"  uas  already  used  for  accusative).  An 

intransitive  verb  is  still  narked  "I,"  and  "U“  (for  "Ueafall")  is  used  for 
dative  pronouns  used  reflexively.  "Z"  is  used  if  a rankehifted  "zu"  clause  Is 
required,  as  in: 

Auch  der  Trichter  pflegt  dabei  HaaffSr.  iUiatfBLiian* 

At  the  ease  tine,  the  asbulstory  funnel  usually  squirts  out  Mater. 

I have  not  ueed  categorise  like  "required  location,"  eince  this  seene  to  be 
part  of  the  broader  phenosenon  of  eesantic  relatione  betueen  argusente  of  the 
verb,  uhich  is  handled  by  the  sesantic  cosponent.  (In  this  case,  a selection 
reetriction  uould  be  ueed.)  A verb  uith  a required  location,  then,  ie  narked 
uith  E,  P,  A+P,  etc.  as  relevant.  For  a cosplete  list  of  the  transitivity 
types  used  in  the  syetes,  eee  Appendix  A. 

2.4  PROGRAMMAR  and  Gersan 

A netuork  like  Figure  2.2  gives  a description  of  structures  possible  in  • 
language,  but  dose  not  specify  hou  us  go  about  relating  a given  sentence  to 
this  descriptive  inforsation.  One  solution  to  this  probles  uas  given  by 
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Uinograd,  and  for  the  interpretive  grammar,  I followed  hie  approach  quite 
cloeeig.  Uinograd’e  approach  is  not  the  only  way,  of  course,  to  use  the 
information  in  the  networks  to  guide  parsing,  and  I will  come  back  to  thie 
issue  in  section  2.7.2.  The  German  interpretive  grammar  uae  written  uelng 
PROGRAflttAR,  a LISP-embedded  language  documented  In  (Ui nograd, 38) . In  brief, 
PR0GRATV1AR  provides  facilities  for  conetructing,  inspecting,  and  manipuloting 
a parse  tree.  The  basic  function  is  (PARSE  <features>),  which  Inepecte  the 
input  sentence  and  tries  to  add  the  specified  node  to  the  *"60.  A group  of 
feature-examining  functions  (NQ,  HQ,  CQ,  ISO,  etc.)  allou  Inspection  of  the 
sentence  or  tree  for  particular  features,  and  another  group  (among  them,  F, 

FQ,  R,  RQ,  ADO-F-NOOE,  and  REMOVE -F-NOOE)  allou  changee  to  be  made  in  the 
features  of  a node.  For  moving  around  the  parse  tree  there  Is  the  function 
MOVE-PT,  uhiie  MOVE-PTU  can  be  used  to  move  around  the  input  eentence.  If  a 
parse  turns  out  to  be  incorrect,  the  backup  functions  POP  and  POPTO  may  be 
used  to  remove  particular  nodes  from  the  tree.  The  basic  statement  type  le 
the  branch  statement: 

(:(<function  or  variable>)  <label-l>  <label-2>  <(abel-3>) 

Control  goes  to  label-1  if  the  function  or  variable  evaluates  to  non-nil,  to 
label-2  if  the  value  is  nil,  and  to  label-3  if  the  end  of  the  sentence  has 
been  reached.  Labe  I -3  is  optional. 

Since  PR0GRAN1AR  was  designed  to  handle  English,  some  changee  and 
extensions  were  necessary  for  processing  German.  These  involved  the  addition 
of  another  syntactic  level,  that  of  the  phrase,  the  expansion  of  the  apparatus 
that  assigns  feature  lists  to  words  and  nodes,  and  a mechanism  for  handling 
partial  information  as  it  is  accumulated.  The  rest  of  this  section  will 
diecuse  these  additions  to  PROGRAMMAR. 

Ae  in  Uinograd's  eystem,  the  actual  parsing  ie  '’one  by  the  syntactic 
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specie) lets  called  by  the  PARSE  function.  Syntactic  special  lata  correspond  to 
units,  so  ua  have  CLAUSE.  NG.  AOJG,  and  PREPG.  In  addition,  tha  Garaan  parser 
contains  routines  that  handle  phrases:  that  is,  constituents  that  often 

appear  together  and  for  uhich  subrout  I nizet  ion  aakes  sense,  but  uhich  do  not 
enjoy  the  theoretical  status  of  a group  or  clause.  The  basic  difference 
between  the  trestaent  of  groups  and  phrases  is  that  a node  is  not  established 
for  a phrase  when  Its  routine  is  entersd,  but  a group  always  has  its  own  node 
aarked  with  its  naae  end  features.  Phrase  progress  are  uecd  to  handle  things 
like  verbs  and  objects  of  verbs.  The  c.^aponents  of  these  phrasee  are 
interrelated,  so  ue  would  like  to  handle  thee  together.  They  are  not  full 
unite  of  the  graaaer,  however,  since  the  coaponents  do  not  have  to  reaain 
contiguous  under  all  circuastance^.  For  exaaple.  In  Geraan  a direct  object 
aay  appear  before  the  finite  verb,  while  the  Indirect  object  of  the  ease 
sentence  coses  after  the  verb.  No  changes  had  to  be  Bade  in  PR0GRATV1AR  in 
order  to  write  phrase  routines,  s’nce  they  are  treated  like  ordinary 
subroutines.  Phrase  prograas  look  iike  group  progress  except  that  they  do  not 
use  the  reserved  tags  RETURN  and  FAIL.  Nodifying  PROGRAiflAR  to  perait  use  of 
these  would  not  have  been  particulary  difficult,  and  for  unlforaity  the  change 
should  probably  have  been  aade. 

The  case-gender-nuaber  combinatorics  of  Geraan  (described  below  in  the 
aorphology  eection)  aade  it  necessary  to  switch  froa  a single  list  of  possible 
features  associated  with  each  input  word  in  the  original  PROGRAfflAR  to 
aultiple  feature  lists.  Each  possible  usage  of  a word,  then,  is  expreseed  ae 
a different  feature  list.  To  handle  these,  a feu  siaple  changes  were  aade  in 
PROGRAHMAR.  First,  aost  functions  now  handle  e list  of  features  with  an 
lap!  led  and  linking  the  entries.  Thus  (NQ  ttASC  SING)  checks  i see  if  eoae 
feature  list  associated  with  the  next  word  has  both  flASC  end  SING  propertied. 
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It  would  fail,  for  example,  if  (NOUN  MASC  PLUR)  and  (NOUN  FEU  SING)  ware  the 
feature  eete  in  question. 

Two  other  additions  to  PROGRAMMAR,  FIX  and  NONEX,  were  also  Motivated  by 
the  proliferation  of  case,  number,  and  gender  possibilities.  They  are  used 
for  dealing  with  partial  information  and  are  discussed  further  in  section 
2.6.2.  To  discuss  the  interpretive  process,  let  us  start  with  the  morphology 
program,  since  this  is  the  first  stop  made  by  an  input  sentence. 

2.S  Morphology 

2.3.1  Analyzing  Morphological  Tags 

Given  a word,  the  job  of  the  morphology  component  is  to  determine  ite 
root  and  then  make  up  a list  of  syntactic  feature  sets  from  information 
associated  uith  the  root  and  endings.  Morphology  finds  its  information  in  the 
German  dictionary,  which  contains  both  roots  and  endings.  Syntactic 
information  for  a root  is  listed  under  the  keyword  FEATURES,  where  there  ie 
one  feature  set  for  each  possible  usage.  Thus  for  brei  t (wide; . which  might 
appear  in  contexts  like  "die  brei ten  Strasssn*  ("the  broad  streets”)  and  "Die 
Chromatophoren  brei ten  eich  aus,"  ("The  chroma tophores  spread  out”)  the 
syntactic  part  of  the  dictionary  entry  looks  iiket 

(OEFS  BREIT  FEATURES  ( 

(VERB  REG  -SEPPR  AUS) 

(AOJ  ATTR  COMP  SUP)  ) 

In  other  words,  brei t may  be  either  a regular  verb  that  has  the  separable 
prefix  aus.  or  an  attributive  (that  is,  pronominal)  adjective  that  can  form  a 
comparative  or  a superlative.  Actually,  such  dictionary  entries  contain  more 
information,  and  the  complete  specification  may  be  found  in  Appendix  A. 

Morphology  finds  its  ending  intonation  as  a list  of  feature  sets 
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indexed  by  ENOiNC,  and  then  the  part  of  speech.  Endings  are  harked  by  eo 
there  ie  no  chance  of  confusing  ths  ending  >ES  ulth  the  uord  eft*  (This 
distinction  is  more  for  ths  benefit  of  ths  user,  since  the  ENDING  index  ie 
enough  to  keep  the  system  on  ths  right  track.)  Part  of  the  information 
associated  with  >ES  looks  1 1 km  s 

(OEFO  >ES  ENDING  ( 

(PRON 

(PRON*  ABSTRACT*  GEN  SING)) 

(NCJN 

(NOUN*  STRONG*  GEN-ES*  GEN  SING) 

(NOUN*  (1IXE0*  GEN-ES  GEN  SING)) 

(AOJ 

(AOJ*  ATTR*  DECL  STRONG  NEUT  NON  SING) 

(AOJ*  ATTR*  OECL  STRONG  NEUT  ACC  SING)))) 

There  are  two  main  routine*  in  morphology,  INPUT  and  TRY. 

2.5.2  The  Routine  INPUT 

INPUT  ie  the  German  equivalent  of  Uinograd'e  morphology  analyzer.  It 
starts  at  the  end  of  a uord,  making  successive  cuts  until  all  ending 
possibilities  have  been  tried.  Uith  German  we  gst  involved  in  compound 
endings,  for  example  when  the  present  participle  is  used  as  an  adjective,  as 
in  veranlasscnde  (causing)  - veranlass  + and  + a.  In  addition,  there  are  eome 
prefixes  to  consider,  as  is  the  case  uith  g a in  the  past  participle,  and  there 
are  also  some  infixes,  i.s.  g&  and  jy,  as  in 

ausgearbei tat  (worked  out)  • aus  + ge  + arbeit  + et 
anzuschauen  (to  look  at)  - an  + zu  + schauen 
The  input  program  handles  all  regularly  occurring  morphological  changes  and 
also  takes  care  of  some  non-standard  situations  like  the  addition  of  an  umlaut 
to  the  verb  lassen  in  third  person  singular  ( ISsst) . Cases  that  are  not 
handled  by  INPUT’S  ending  analyzer  appear  directly  in  the  dictionary.  These 
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include  the  various  incarnations  of  as  in  (ic.  bs.) » past  participles  uith  a 
vowel  change  like  gebrochen  (broken) . and  nouns  with  unusual  plurals  like 
Sepia  (p I . Sepien) . 

2.5.3  The  Routine  TRY 

Once  INPUT  thinks  it  has  a likely  split,  it  sends  the  stem  and  ending 
list  off  to  TRY.  The  first  step  here  Is  to  check  to  see  if  the  proposed  root 
does  indeed  appear  in  the  dictionary.  If  so,  we  pick  up  its  syntactic 
features  and  hold  on  to  them.  Ue  also  pick  up  features  associated  with  the 
different  endings.  It  is  at  this  point  that  ue  begin  to  notice  some  special 
problems  associated  uith  German  morphological  processing.  Since  an  adjective 
ending  may  have  four  cases,  three  genders,  tuc  numbers,  and  may  be  strong  or 
ueak,  the  combinatorics  begin  to  be  a problem.  And  this  accounting  does  not 
even  take  into  consideration  verbs,  nouns,  or  participles  some  of  uhoee 
endings  may  coincide  uith  adjective  endings.  For  this  reason,  TRY  makes  a 
first  pass  to  d«*»—'ne  the  parts  of  speech  possible  for  the  root  and  then 
iooks  at  ths  endings  to  see  of  they  form  a psrmieeible  pattern,  given  the  part 
of  speech.  For  example,  brei tes  (broad)  nssd  not  bs  tried  as  a verb,  eince  no 
German  verb  is  formed  by  adding  u t3  s root.  Here,  only  the  possibilities 
for  an  adjective  need  be  considered,  and  sines  the  endings  lists  are  all 
indexed  by  parts  of  speech,  it  is  a simple  matter  to  pick  out  the  relevcnt 
possibi I i ties. 

Having  narrowed  the  field  someuhat,  the  next  step  Is  to  call  the  routine 
MERGE.  MERGE  moves  through  ths  endings  lists,  starting  uith  the  lists  for  the 
last  ending  and  uorking  back  to  the  list  for  the  ruot.  1 .s  job  is  to  compound 
information  and  siiminate  bad  combinations.  To  do  this,  MERGE  needs  to  knou 
uhich  part  of  the  ending  possibility  ilst  is  required  information  and  which  ie 
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new.  In  the  sgstem,  stare  denote  information  that  must  be  preeent  in  the 

preced'ng  feature  list  and  unmarked  features  are  simplg  added.  As  an  example 

of  the  matching  and  compounding  done  in  MERGE,  take  I i eoendes  ( luina) . which 

* a participle: 

I i eg:  (VERB  IRR  MYB) 

-end:  (VERB*  PRESP) 

-es:  (PART  PRESP*  STRONG  NEUT  NOM  SING) 

(PART  PRESP*  SiRONG  NEUT  ACC  SING) 

Matching  on  starred  slemente,  and  ?dding  the  unstarred  information,  we  get: 

(PART  PRESP  STRONG  NEUT  NOM  SING  IRR  MYB) 

(PART  PRESP  STRONG  NEUT  ACC  SING  IRR  MVB) 

Theee  are  simplified  versions  of  the  two  feature  sete  that  will  be  aesociated 
with  thr  word  I i eoendes.  A speciai  action  was  taken  here  bg  the  routine  TRY 
because  we  are  dealing  with  a change  in  part  of  epeech.  For  thie  epecial 
case,  the  feature  VERB  was  rtioved  after  PART  was  added,  to  prevent  the  part 
of  speech  designation  from  becoming  ambiguous  in  the  final  feature  eete.  This 
deletion  is  done  bg  a simple  check  in  TRY,  since  a part  of  speech  change 
occurs  in  onlg  a few  caseR. 

Each  call  of  TRY  bg  INPUT  mag  add  feature  eete  to  the  sgntactic  feature 
tiet,  so  that  in  fact  a word  mag  bs  divided  in  several  wags.  To  keep  the 
possibilities  straight,  a root  iist  is  aiso  construe  . J,  with  an  entrg  that 
corresponds  to  each  feature  set. 

2.S.4  Special  Features  of  INPUT 

If  INPUT  is  not  successful  with  its  initial  ending  analgsie,  it  looks 
for  a compound  word.  Compound  words  appear  frequent Ig  in  German;  often  where 
English  would  use  a classifier  pi  us  a noun,  German  uees  a compound.  The 
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Method  used  is  a brute  force  one.  The  uord  is  spilt  into  tuo  parte  and  each 
ot  these  is  fed  to  a recursive  call  of  IhPUT.  If  both  sections  turn  out  to  be 
uords,  us  construct  a feature  list.  If  not,  then  ue  Move  over  a letter.  Make 
another  split,  and  try  again.  All  sorts  of  refinements,  e.g.  only  Making 
splits  betueen  syllables,  are  possibilities  here,  but  nothing  like  this  hae 
been  done.  Right  nou,  the  system  handles  only  coapounds  made  froa  tuo 
components,  but  the  code  could  be  generalized  fairly  easily.  The  coapound 
ana'yzer  Mill  accept  noun  + noun  pai'““  like  Chroea toohorenep i e I ("play  of  the 
chroMatophores") , verb  •>  noun  pairs  like  Leuchtoraan  ("light  organ"),  and 
pronoun  + infinitive  used  as  a noun  pairs  like  Sichauf f inden  ("finding  each 
other") . 

Another  feature  of  INPUT  is  its  handling  of  infinitive  verbs  used  ae 
nouns.  If  a uord  is  evaluated  as  an  infinitive  verb,  a email  routine  is 
called  to  add  features  and  semantics  for  an  infinitive  used  as  a noun.  Note 
that  in  a normal  text,  both  verb  and  noun  uouid  not  be  possible  at  the  eaae 
time,  since  nouns  uouid  bn  capitalized.  The  teralnai  used  here  for  input, 
houever,  had  only  upper  case,  and  it  seemed  that  any  special  conventions  for 
nouns  uouid  be  a burden  on  the  user.  For  this  reason,  nouns  are  not 
distinguished  from  the  rest  of  the  German  input,  and  the  system  just  works  a 
little  harder  to  pick  them  out. 

2.5.5  An  Alternative 

The  Morphology  componont  works  well,  with  only  one  real  hitch!  uords 
ending  in  bq  take  a considerable  length  of  time,  even  uith  the  special  passes 
made  to  cut  combinatorics.  This  may  be  an  indication  that  aerphoiogy  and 
syntax  should  not  be  a tuo-pass  proposition,  but  rather  that  the  state  of  the 
par*'!  should  be  used  to  limit  possible  morphological  analysis  in  the  next 
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uord.  Thus  if  ue  have  "einem  a!ten  Mann"  ("an  old  nan",  dative  case),  bg  the 
time  the  e i new  has  been  parsed  ue  hive  gathered  enough  inf  or  Ration  about  a I ten 
to  limit  it  to  tuo  possibilities:  either  (ADJ  WEAK  OAT  SING  ftASC)  or  (AOJ 
UEAX  OAT  SING  NEUT).  Therefore,  to  solve  morphology’s  combinatoric  problems, 
ue  might  distinguish  tuo  levels  of  morphological  features.  The  higher  level 
features  could  be  assigned  in  a preprocessing  pass  like  the  present  one.  At 
that  point  ue  might  just  specify,  say,  that  an  adjective  had  been  found  uith  a 
permissible  adjective  ending  (AOJ  DECL).  Later,  in  parsing  the  noun  group,  a 
second  morphological  pass  could  check  to  eee  if  the  proposed  adjective 
exhibited  the  correct  case,  gender,  number,  and  type  uith  respect  to  the 
determiners  and  other  adjectives  in  the  noun  group.  Uith  this  approach,  the 
combinatorics  of  adjective  endings  need  only  be  tackled  uhen  it  appears 
absolutely  necessary.  This  approach  uould  not  be  difficult  to  implement,  but 
it  uould  involve  considerable  effort  to  convert  the  existing  eystem  to  use  it. 

2.8  The  Operation  of  the  Grammar 

The  interpretive  grammar  operates  on  the  string  of  uords  and  feature 
lists  output  by  the  morphology  routines.  It  goes  to  uork  to  construct  a paree 
tree,  and  at  any  given  time  the  grammar  ui  II  be  follouing  up  only  one  paree. 

If  syntactic  ambiguities  lead  the  grammar  astray,  special  backup  routines  are 
called  to  find  the  difficulty  and  set  the  grammar  onto  another,  hopefully  more 
successful,  path.  It  does  not  seem  profitable  to  discuss  the  interpretive 
grammar  in  detail,  since  its  behivior  is  so  close  to  that  of  Uinograd’s 
English  grammar.  A sample  pares  may  be  found  in  Appendix  B,  and  readere 
uishing  further  information  on  the  approach  to  parsing  should  consult  Uinograd 
(39,  chap.  5)  and,  for  details,  Rubin  (32).  Uhat  do  seem  to  be  uorth 
discussing  are  the  places  uhere  German  presents  special  problems  or  where  a 
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different  approach  was  taken,  so  this  section  Mill  be  devoted  to  an  assortment 
of  special  topics. 

2.6.1  The  Denise  of  the  Verb  Group 

As  ins  Mentioned  previously,  the  German  grammar  has  special  programs  for 
clauses,  noun  groups,  preposition  groups,  and  adjective  groups.  There  Is  no 
verb  group  program,  but  there  is  a verb  phrase  routine  instead.  The  demotion 
of  the  verb  group  follows  Hudson  (20),  who  argues  at  one  criterion  for  a 
group  is  that  its  components  must  be  contiguous.  In  English,  of  course,  verba 
do  stick  together  a good  part  of  the  time,  and  it  is  easier  to  make  a case  for 
the  existence  of  a verb  group.  In  German,  however,  verbs  are  separated  quite 
frequently,  for  example,  in  modal  constructions:  "Er  muss  frOher  aufetehen" 
("He  must  get  up  earlier,”  literally,  "He  must  earlier  up  get”).  In  fact, 
whenever  there  are  verbs  other  than  the  finite  verb  In  a major  clause,  German 
word  order  requires  that  these  other  verbs  go  to  the  end.  Giving  verbs  a 
phrase  insteao  ot  a qroup  status  does  not  prevent  the  grammar  from  developing 
the  special  relationships  that  occur  between  verbe  in  a sentence.  It  ie  the 
clause  program,  however,  instead  of  a verb  group  p.  ogram,  that  ie  responsible 
for  developing  these  relations  or  calling  Its  associated  semantic  rouMnee  to 
do  so. 


2.6.2  Handl ing  Partial  Information 

The  original  PROGRAfltlAR  comes  equipped  with  three  mechanisms  for 
recording  information  accumulated  In  the  course  of  a parse.  First,  there  Is 
the  construction  of  the  parse  tree  itself.  Second,  there  are  routines  to  add 
features  to  a parse-node,  and  third,  we  can  set  snd  access  varlable-like 
registers  associated  with  a node.  Actual iy,  there  is  a fourth  mechanism. 
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since  the  control  structure  itself  is  a way  of  holding  onto  distinctions 
within  a routine.  None  of  these  Mechanises,  however,  autoeatical  ly 
distinguish  between  inforeation  that  is  in  soee  sense  fragaentary  and 
inforeation  on  which  further  decisions  can  be  based.  By  fragaentary  or 
partial  inforaation,  I aean  inforaation  about  choices  that  have  been  narrowed, 
but  not  fully  decided.  For  ex„T»ple,  the  definite  article  dea  in  a noun  group 
is  DATive,  SINGular,  and  either  flASCulins  or  NtUTer.  It  is  useful  to  know 
that  FEflinine  has  been  eliainated  froa  the  gender  systea  as  a possibility,  but 
this  is  only  partial  inforaation,  since  at  this  point  the  parser  still  sees 
dea  as  aabiguous.  A parsing  systea  should  have  ways  to  deal  with  this  partial 
inforaation  easily,  both  to  designate  the  inforaation  itself  and  to  tell  the 
parser  where  the  partial  inforaation  is. 

Largely  in  response  to  the  gendsr-nuaber-cass  coabinator ics,  two  new 
facilities  were  added  to  PROGRATflARj  FIX  and  NONEX.  FIX  gives  us  a way  of 
handling  partial  inforaation  before  a parsenode  is  constructed.  In  the 
English  version  of  PR0GRAT51AR,  the  only  way  to  specify  the  features  required 
in  a word  is  to  use  these  as  paraaeters  of  the  actual  function  call  of  PARSE. 
Uith  FIX,  we  can  eliainate  possible  parses  of  the  next  word  as  the  relevant 
inforaation  is  encountered.  For  exaaple,  (FIX  flASC  SING)  aoves  any  feature 
sets  that  are  not  both  MASC  and  SING  to  the  back  of  the  list.  Siailarly,  we 
can  say  (FIX  OR  MASC  NCUT)  , which  exiles  feature  sets  that  are  not  either 
MASC  or  NEUT.  Feature  sets  that  have  been  eliainated  are  put  behind  a Marker 
so  that  they  are  no  longer  accessible  to  the  PARSE  function,  although  it  is 
easy  to  recover  old  possibi  I ities  by  erasing  the  Marker.  FIX  May  be  used 
several  tiaes,  then,  to  narrow  the  possibilities  before  PARSE  is  finally 
called.  One  facility  that  FIX  could  have  but  does  not  right  now  is  FIX  N01 , a 
way  to  disqualify  feature  sets  that  contain  the  feature  given. 
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One  place  uhere  FIX  Is  ussd  frequently  Is  In  dealing  with  verb  phrases. 
Consider  the  example) 

Eine  Eledone.  deren  s&mtliche  Saugnftpfe  entfernt  uorden  slnd,... 

An  eledone,  whose  suckers  have  all  been  reeoved,... 

After  parsing  the  past  participle  worden.  we  know  that  the  next  word  Bust  be  a 
fore  of  sein  and  either  an  INFlnitive  or  a finite  verb.  Ue  can  use  FIX  to 
record  these  facts,  and  then  check  to  see  If  the  verb  is  finite.  (All  but 
first  and  third  person  plural  of  eost  verbs  can  be  unaabiguousiy  distinguished 
from  the  infinitive  fora.)  Since  it  turns  out  that  Bind  is  a finite  form,  it 
should  agree  with  the  subject,  eo  ue  can  cat  I FIX  again  with  the  person  and 
nunber  of  SauanSofe;  (FIX  P3R0  PLUR).  Note  that  the  addition  of  FIX  doee  not 
give  PROGRAfflAR  any  new  power,  since  ue  always  could  have  done  the  sa*e  eorte 
of  things  by  setting  variables  to  oe  used  later  In  the  call  to  PARSE.  FIX 
■erely  Bakes  it  easier  to  accuaulate  inferaation  about  the  next  word  to  be 
parsed,  even  if  this  inforaation  is  found  in  widely  scattered  parte  of  the 
graaaar. 

NONEX,  for  non-exclusive  parse,  allows  the  PARSE  routines  to  live  with 
aabiguity,  at  least  to  a liaited  extent.  Uhen  ue  sake  a call  like  (PARSE  AOJ 
OAT  SING  NONEX),  ue  are  saying,  "Eliminate  feature  sets  that  don't  agree  with 
the  features  specified,  but  if  aore  than  one  feature  set  is  left  (say,  sets 
with  different  genders),  don’t  worry  right  now.”  In  the  grammar,  NONEX  pareee 
are  used  within  noun  groups,  so  that  we  are  not  forced  to  sake  case,  number, 
and  gender  distinctions  on  adjectives  and  determiners  before  the  necessary 
information  ie  in.  In  *he  noun  group,  the  ambiguity  will  only  rarely  persist 
beyond  the  point  uhere  the  main  noun  is  parsed.  Code  is  built  into  the  noun 
group  specialist  to  allow  us  to  go  back  and  clean  up  NOfO  parses  (I. a,  pick 
the  correct  feature  set)  when  it  is  possible  to  do  so.  Another  place  that  the 
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noun  group  specialist  uses  NONEX  is  in  parsing  pronouns.  Ue  sag  not  know  the 
gender  or  number  of  a pronoun  until  its  referent  has  been  found.  (Ue  may  oleo 
not  knou  the  case,  but  that  is  handled  bg  backup  instead;  see  the  next 
section).  NONEX  allous  us  to  do  the  best  ue  can  uith  a pronoun,  maybe  ueing 
subject-verb  agreement  to  limit  the  possibilities.  Uhen  the  referent  is 
found,  a process  usually  not  done  until  the  end  of  the  sentenco,  ue  can  clean 
up  the  pronoun  node. 

FIX  and  NONEX,  then,  make  it  easier  to  handle  partial  information.  They 
do  not,  houever,  really  cose  to  grips  uith  some  of  the  deeper  problems  of 
pareing  uncertainty,  uhich  are  discussed  in  section  2.7.1. 

2.G.3  Objects  of  the  Verb 

Uhile  the  main  verb  in  English  almost  aluays  precedes  its  objects,  in 
German  this  is  much  less  often  the  case.  As  uas  mentioned  above,  whenever 
there  is  more  than  one  verb  in  a major  clause,  all  but  the  finite  verb  go  to 
the  end.  In  addition,  most  secondary  clauses  are  end-order,  i.e.  all  verbe 
are  at  the  end.  Thus,  ue  frequently  find  ourselves  confronting  objects  of  the 
verb  uith  no  inkling  of  uhat  the  sain  verb  is.  To  further  complicate  the 
situation,  the  ordering  uf  different  objects  say  depend  on  uhether  one  or  both 
of  them  are  pronouns,  and  uhat  sort  of  pronouns  they  are.  The  situation  le 
complex  enough,  I think,  to  force  a factoring  of  the  problem.  To  thie  end,  \ 
have  made  tuo  distinctions,  one  of  uhich  seems  successful,  uhile  the  other 
seems  less  satisfying. 

Let  us  first  consider  the  more  successful  measure.  Object  parsing  uae 
divided  into  tuo  passes,  the  VERB-OB*£CTS  routing  (a  phrase,  rather  than  a 
group,  routine)  and  the  UORD-ORDER-CHECK  routine.  VERB-OBJECTS  finds  noun 
groups,  preposition  groups,  etc.  and  then  U0RD-0R0ER -CHECK  decides  uhether 
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they  are  in  the  correct  order.  Thie  division  of  labor  had  nothing  to  do  uith 
efficiency  or  a vision  of  "uhat  people  do."  It  uae  Merely  an  attempt  to  avoid 
a rat’e  neat  of  complex  prograaeing.  Ideally,  the  search  for  objects  and  a 
check  on  their  uord  order  should  probably  be  done  in  parallel,  but  the  only 
disadvantage  I can  see  in  the  uay  I have  factored  the  problem  ie  that  it  Might 
take  a little  longer  to  reject  a bad  parse  on  ordering  grounds. 

A second  aspect  of  the  grammar's  handling  of  objects  is  the  design 
decision  that  the  case  of  a noun  group  is  a higher  level  feature  than  its 
gender  or  number.  That  is,  as  it  stands  nou,  the  noun  group  specialist  Must 
aluays  be  called  uith  a case  specified.  My  Motivation  for  doing  thie  uae  that 
at  a given  point  in  the  parse,  noun  group  case  is  often  predictable.  This  uae 
a bad  decision,  since  if  ue  make  the  call  (PARSE  NG  ACC)  and  If  there  le  a 
dative  noun  group  rather  than  an  accusative  one,  the  noun  group  epecl allot 
u i II  fail,  never  knouing  uhat  it  missed.  The  alternative  is  to  permit  NG  to 
be  called  uithout  case  specification  and  to  have  it  parse  any  noun  group, 
reporting  back  the  case  that  it  finds.  This  uould  be  a relatively  simple 
change  to  make,  although  ue  could  get  into  trouble  uith  possible  ambiguities 
betueen  nominative  and  accusative  cases  for  neuter  singular,  feminine 
singular,  and  plurals.  As  it  stands  nou,  it  uould  take  some  extra  mechanism 
to  handle  this,  but  a simple  change  to  allou  negative  specification  of  a parse 
(i.e.  "parse  anything  but  a nominative  noun  group")  uould  be  sufficient. 

Allouing  the  noun  group  specialist  to  be  called  uithout  case 
specification  uould  improve  the  efficiency  of  VERB-OBJECTS  and  several  other 
routines,  but  it  uould  not  change  the  structure  of  VERB-OBJECTS  greatly.  As 
it  stands  nou,  VERB-OBJECTS  Is  called  both  uhnn  the  main  verb  hae  been  found 
and  uhen  it  hae  not  been.  The  routine  uorks  from  a shopping  liet  found  in  thm 
register  FILTER.  If  the  main  verb  hae  been  found,  then  FILTER  ie  a liet  of 
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the  sorts  of  transitivity  types  of  objects  it  may  take  (These  uere  described 
in  section  2.3.13).  If  no  main  verb  has  yet  been  found,  the  Rain  clause 
program  can  usually  tell  whether  we  are  looking  for  active  or  passive  object 
types  and  set  FILTER  to  these,  in  soRething  like  a secondary  clause,  FILTER 
ie  set  to  all  possibilities,  of  which  there  are  currently  24.  Note  that  thie 
is  not  as  Inefficient  as  it  eesRS,  since  any  attempt  at  parsing  a set  of 
objects  will  give  us  information  that  can  be  used  to  update  the  possibilities 
In  FILTER.  For  example,  FILTER  is  always  ordered  from  longest  to  shortest, 
with  noun  groups  considered  longer  than  prepositions  (i.e.  A+A  before  A+P 
before  A before  P ).  Thus,  if  at  any  point  w*  fall  to  find  a noun  group  for  a 
eecond  object,  we  can  eliminate  all  double  noun  group  types  from  FILTER.  Uith 
the  exception  of  the  problem  uith  noun  group  case  specification  mentioned 
above,  parsing  of  verb  objects  proceeds  in  an  orderly  and  fairly  efficient 
fashion,  even  when  the  sain  verb  has  not  been  found. 

2.6.4  Limiting  the  Parse 

Uhen  I started  this  project,  I naively  thought  that  parsing  German  uouid 
be  a simpler  matter  than  parsing  English.  The  reason  for  this  belief  was  the 
very  thing  that  gave  the  morpholo^  component  such  a headaches  the  abundance 
of  case,  gender,  number,  and  person  distinctions.  Natural  languages,  however, 
are  very  finely  balanced.  The  German  syntactic  components  are  carefully 
tagged  because  word  order  has  a much  wider  degree  of  flexibility.  I already 
knew  that  objects  of  the  v*rb  have  more  freedom  in  German  than  in  English; 

*0en  Mann  kenne  ich"  is  perfectly  fine  ("I  know  the  man,”  literally,  "The  man 
know  I”),  eyen  ”0em  Mann  gab  ich  es”  is  not  surprising  (”I  gave  it  to  the 
man,”  literally,  ”To  the  man  gave  I it”).  Uhat  gave  the  parser  the  most 
trouble  as  it  was  being  developed  uere  things  like  the  possibility  of  poet- 
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fixed,  at  well  at  pre-fixed,  preposition  groups,  adjectives  that  take 
preceding  noun  groups  at  objects,  clauses  appearing  prsnoainal  Ig,  post-fixed 
genitives  that  are  Marked  by  case  but  have  no  helpfui  cl  Marker  as  in  English, 
etc.,  etc.  In  this  section,  I would  like  to  run  through  a iist  of  the  Methods 
used  to  keep  the  parser  on  the  track.  Soae  of  these  Measures  were  More 
desperate  than  others,  but  I tried  to  at  isast  handle  thee  in  a uniform 
Manner.  Note  that  one  other  very  important  Mechanise  for  limiting  the  parse 
is  semantics,  which  is  discussed  in  the  next  three  chapters. 

The  first  set  of  Methods  for  limiting  the  parse  comes  buiit  into 
PROGRAfflAR.  It  is  easy  to  Move  around  the  parse  tree  and  to  interrogate  the 
next  word  in  the  sentence  about  its  features.  The  CUT  variable  can  be  set  to 
prevent  parsing  from  going  past  a certain  point  in  the  sentence.  Finally, 
message  variables  can  be  set,  so  that  reasons  for  a failure  can  be  recorded. 
One  way  message  variables  were  used  throughout  the  system  was  to  prevent  a 
second  parse  attempt  when  the  first  one  had  already  failed.  For  example,  if 
we  cal  I (PARSE  NG  ACC)  and  an  accusative  noun  group  has  already  been 
unsuccessfully  attempted  at  this  point,  the  noun  group  routine  returns  failure 
without  any  reparsing.  Aithough  there  is  bomb  overhead  in  setting  up  a node 
(here  the  noun  group  node)  when  a PARSE  call  is  made,  checks  at  every  calling 
point  would  be  cumbersome.  Therefore,  the  individual  syntactic  special  iste 
were  Made  responsible  for  checking  the  failure  list. 

In  addition  to  the  ues  of  Message  variables,  the  programs  do  some  look- 
ahead in  the  sentence.  I am  not  sure  whether  to  be  happy  with  thie  approach 
or  not.  There  is  nothing  inherently  wrong  with  iook-ahead  in  text  proceseing, 
but  I suspect  that  it  should  be  More  (uiiy  integrated  into  the  design  of  the 
parser  (see  section  2.7.2).  Uhatever  the  case,  the  look-ahsad  used  was  eimple 
and  reasonably  effective.  An  exampie  is  the  prenoMinal  ciause  iike  "die  im 
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Nervensyetem  verlaufenden  Erregungen*  ("the  excitations  that  run  through  the 
nervous  sgstee. “)  If  there  is  no  present  or  past  participle  anywhere  in  the 
sentence,  a call  for  a PRESP  or  PAP'P  clause  will  use  look-ahead  and  fail 
immediately.  If  this  were  not  done,  we  would  probably  end  up  parsing  the  siain 
noun  of  a noun  group  as  a verb  object  and  go  to  a lot  of  trouble  before  it 
became  clear  that  no  pronominal  clause  was  present.  Since  prenominal  claueee 
can  occur  in  just  about  any  full  noun  group,  this  could  elow  down  the  system 
considerably.  I should  note  that  the  look-ahead  mechanism  here  could  break 
down  in  very  long  and  complex  sentences,  where  a lot  of  different  syntactic 
structures  are  present.  As  it  is  now.  If  there  is  a member  of  the  word  class 
anywhere  in  the  sentence  - even  twenty  words  away  - the  look-ahead  wi  1 1 be 
satisfied  and  a parse  will  be  attempted.  This  rudimentary  look-ahead,  then, 
is  not  a panacea,  but  it  does  allow  the  parser  to  take  eimple  actions  for 
simple  sentences. 

Two  other  parser- 1 i mi  ting  mechanisms  are  more  conventional.  Firet,  at 
the  beginning  of  the  more  complicated  routines,  entry  conditions  were  set  up. 
If  the  next  word’s  pose'ble  parts  of  spssch  do  not  match  those  in  the  entry 
condition,  failure  Is  immediate.  A ssr.ond  measure  is  to  distinguish  three 
levels  of  noun  group:  FULL,  SIMPLE,  and  NO-RSQ.  Uhen  PARSE  is  called  for  a 
FULL  noun  group,  it  is  free  to  try  anything.  SIMPLE  noun  groups  exclude 
rankshifted  noun  groups  (RSNO  - like  "ich  weiss,  dasa  gg  wahr  ist"  / "I  know 
that  i t la  true. ")  Finally,  NO-RSQ  noun  groups  cannot  be  RSNG  and  say  not  have 
rankshifted  qualifiers.  Verb  objects  in  major  clauses  are  parsed  with  FULL, 
while  objects  of  prepositions,  for  example,  are  parsed  with  SIMPLE.  NO-RSQ  ie 
used  primarily  within  prenominai  clauses  to  prevent  embedding.  (Actually,  we 
might  want  to  allow  embedding  to  or.a  level  of  PRESP  and  PASTP  claueee.  Thie 
would  be  a simple  change.)  The  noun  group  distinctions  save  time  and  pareer 
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effort,  and  I do  not  feel  that  they  seriously  curtail  the  generality  of  the 
grammar.  Multi-level  embedding  etraine  human  comprehension,  and  it  ie  fair  to 
treat  any  embedding  of  like  elements  beyond  a certain  level  ae  a pathological 
caee. 

Finally,  if  all  else  faile,  there  is  backup.  The  routinee  used  in  the 
syetem  will  be  deecribed,  but  ! should  note  that  the  backup  mechanic*  used  ia 
not  the  beet  poseible  one.  Interested  readers  are  referred  to  Hill  (19)  for 
an  analysis  of  backup  methods  and  a description  of  "explicit  backup."  Uhile 
the  backup  routines  in  tho  grammar  ware  written  only  ae  the  need  aroee,  they 
do  handle  some  of  the  more  common  hazards.  The  four  routines  are  VERB-BACKIH*, 
TRANS-BACKUP,  SUBJ-BACKUP,  and  SEMI -CL -BACKUP.  The  firet,  VERB-BACKUP,  ie 
epecific  to  the  system.  Its  job  is  to  rescue  verb  infinitives  that  were 
mietakenly  parsed  as  nouns  - a problem  that  would  not  arise  if  the  .ystem 
distinguished  between  upper  and  lower  case  letters  (since  nouns  are 
capitalized  in  German).  TRANS-BACKl!0  is  called  if  the  main  verb  is  pareed 
after  its  objects  and  if  the  transitivity  possibilities  of  the  verb  do  not 
match  the  objecte  found.  This  routine  pops  nodes  from  the  tree  and  eete  the 
necessary  registers  for  another  call  to  the  VERB-OBJECTS  routino. 

SEMI -CL -BACKUP  takes  action  if  the  objects  of  a semi-clause  have  been 
parsod  but  if  there  is  no  participle  or  m plus  infinitive  to  be  found.  The 
routine  checke  to  see  whether  the  verb  was  absorbed  by  one  of  the  objecte  of 
the  verb,  if  so,  it  pops  the  objects,  sets  a cut  point  at  the  verb,  and 
returns  control  to  the  CLAUSE  routine  for  another  try.  The  last  backup 
routine,  SUBJ-BACKUP,  specializes  in  those  German  imjrted  order  clauses  in 
which  the  finite  verb  is  the  main  verb.  Since  the  subject  foiiows  the  verb  in 
inverted  order,  there  is  nothing  to  prevent  a subject  from  absorbing 
preposition  groups  and  objects  that  belong  to  the  clause.  (The  same  ie  true 
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of  secondary  clauses,  but  this  is  handled  by  TRANS-BACKUP.)  Semantic  checking 
helps  some,  but  often  it  is  not  until  the  parser  actually  tries  to  parse 
objects  that  it  discovers  that  something  is  wrong.  As  the  system  stands  nou, 
a subject  noun  group  will  not  mistakenly  appropriate  a preposition  group  (for 
an  explanation  of  this,  see  the  next  section),  but  it  could  pick  up  a verb 
object,  thinking  the  object  was  a genitive.  It  is  the  job  of  SUBJ-BACKUP  to 
intercede  if  the  main  verb  comes  up  short  of  objects,  and  to  chock  to  eee 
whether  the  subject  is  holding  on  to  more  than  it  should.  Object  problems 
with  inverted  order  clauses  whose  finite  verb  is  not  the  main  verb  are  the 
ease  as  for  secondary  clauses  and  are  handled  by  TRANS-BACKUP. 

2.7  Problems  and  Observations 

2.7.1  A Sticky  Problem  and  a Partial  Solution 

One  difficulty  uith  using  backup  for  natural  language  parsing  is  that,  at 

any  given  point,  it  is  not  always  clear  whether  backup  should  be  initiated. 

In  this  section  I would  like  to  discuss  a problem  which  occurs  in  English,  but 

which  appears  in  much  more  florid  form  in  German.  The  eoiution  proposed  doee 

depend  on  backup,  b jt  it  attempts  to  minimize  the  instances  where  incorrect 

parses  will  remain  undetected. 

Consider  a secondary  clause  from  our  example  paragraph! 

Da  aber  manche  in  der  Tiefsee  iebenden  Tintsnfische  In  verschiedenen 
bunten  Farbsn  erstrahiende  Leuchtorgane  besitzon,  ... 

But  since  many  dsepssa  dwelling  cephalopoda  possess  light  organs  that 
shine  in  various  bright  colors  ... 

The  structure  of  this  secondary  clause  is  binder-inter jection  subject-direct 
object-main  verb,  and  the  correct  divieion  between  subject  and  direct  object 
is  after  Tintenf i sche.  A program  parsing  along  blindly,  however,  could 
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appropriate  the  preposition  group  "in  verschisdenen  buntsn  Farben"  as  a 
qualifier  for  the  subject  Tintenf ische.  Syntactically,  the  pareer  Mould  never 
be  the  uiser,  since  "erstrahlsnds  Lsuchtorgans"  is  a perfectly  good  accusative 
noun  group.  Semantical  ly,  too,  it  Mould  take  a fairly  sophisticated  program 
to  know  that  something  uas  amiss. 

In  an  attempt  to  avoid  this  sort  of  situation  the  noun  group  special  iut 
is  cautious,  and,  uhensvsr  a noun  group  could  absorb  preposition  groups  or 
adjective  groups  (as  AQX  POSTNOfl)  that  do  not  belong  to  it,  it  Mill  refrain 
from  doing  so.  Such  preposition  groups,  etc.  Mill  than  often  end  up  bound  to 
the  major  or  subordinate  clause  rode.  This  is  not  a bad  fate,  because  it  is 
often  ths  correct  one.  Sines  academic  German  makes  such  frequent  use  of  the 
pronominal  clause,  it  Ir  less  likely  that  simple  relatione  Mill  be  expreeeed 
with  postnominal  qualifiers.  If,  on  ths  other  hand,  this  is  ths  urong 
decision,  ms  are  in  a better  position  to  find  that  out.  Sines  major  or 
subordinate  clauses  tend  to  bs  mors  fully  specified  than  their  componont  noun 
groups,  even  a relatively  weak  semantics  component  might  be  able  Xn  determine 
that  a clause  has  something  extra,  even  though  It  might  fall  to  do  so  for  a 
noun  group. 

Note  that  in  ths  example  '.bovs,  assigning  rin  vsrschiedsnsn  buntsn 
Farben"  to  the  subordinate  clause  Mould  bs  incorrect,  sines  It  really  belongs 
to  ths  prsnominal  clause  modifying  the  direct  object.  Uhsn  ths  semantic 
specialist  for  the  clause,  SflCLAUSE,  is  called,  it  will  presumably  decide  that 
this  preposition  group  cannot  modify  ths  relation  represented  by  the  verb 
besi  tzsn  ard  transfer  control  to  a backup  routine.  Because  of  time 
limitations,  this  backup  code  has  not  been  written,  but  its  basic  task  would 
bs  to  detect  jurisdictional  disputes.  I4e  already  knou  that  the  prspoeitlon 
group  does  not  modify  the  clause,  but  Me  have  to  check  to  see  whether  the 
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components  on  sither  side  want  to  claim  it.  Uith  some  simple  syntactic 
information  - the  ent;  v conditions  for  different  structures  and  the  Mays  they 
may  terminate  - *e  could  eliminate  c^rta.n  claims  on  the  preposition  group. 

In  the  example  sentence  a simple  syntactic  check  is  not  enough  to  decide 
whether  the  subject  or  the  direct  object  should  get  the  preposition:  so  we 
uojld  have  to  depend  on  the  fuller  syntactic  check  of  a parse  attempt,  uith 
the  accompanying  semantic  checking.  The  bacxup  code  could  call  for  the  tuo 
different  parsings,  which  in  effect  would  allow  the  semantics  programs  to 
direct  the  parse.  This  scheme  is  similar  to  one  outlined  by  Uoods  for  Englieh 
(40);  the  difference  's  the  heuristic  that  assumes  that  modifiers  belong  to 
the  dominant  clause  unless  proven  otherwise. 

2.7.2  Other  Approaches  to  the  Problem 

Uhen  I began  writing  the  interpretive  grammar,  the  question  ( was  asking 
uas  hou  tc  adapt  Uinograd’s  approach  to  handling  German.  SHROLU  is  not  the 
only  uay,  h;  sver,  to  tran'ate  information  like  that  ii  systemic  grammar 
netuorks  into  a parser.  In  the  time  since  Uinograd’s  system  appeared,  there 
has  been  some  interesting  work  on  English  parsing,  notably  that  of  Martin  (24) 
and  of  Marcu9  (23).  Martin’s  approach  takes  the  form  of  a parser  similar  in 
spirit  to  Mood’s  transition  networks,  but  ich  always  expands  all  possii  a 
parses  instead  of  attempting  to  choose  the  most  likely  one  :<nd  backing  up. 
Martin  contends  that  semantics  will  limit  the  number  of  possibilities  at  any 
given  point,  so  that  combinatoric  explosion  is  not  an  issue.  Marcus  proposes 
a "wait  and  mse"  approach,  with  decisions  delayed  until  the  necessary 
information  is  in.  The  ability  to  delay  parsing  decisions  would  be 
particular  ly  useful  for  German:  it  will  therefore  be  interesting  to  see  the 
results  of  this  work.  The  merit  of  these  approaches  is  that  they  avoid  backup 
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Mith  its  accompanying  problems  of  programming  complexity  and  the  possibility 
of  overlooking  ambiguous  cases. 
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Chapter  3 — Ordering  Concept  ftarkers 
3.1  The  Conceptual  Structure 

Cone i during  language  aa  a "structure  organized  to  convey  Meaning,"  ue 
have  discueeed  the  etructure  part  to  eoae  extent  and  nou  Mill  turn  to  the 
queetion  of  Meaning.  By  the  Meaning  of  a uord,  1 Mean  the  group  of  entries  In 
the  conceptual  structure  associated  wi th  that  uord.  But  thie,  of  course, 
eeane  that  ue  nou  need  definitions  for  "entries"  and  "conceptual  structure." 
Another  uord  for  entries  here  is  concepts,  and  it  is  an  open  question  just  hou 
concepts  ehould  be  embodied.  Should  ue  use  rules,  procedures,  I Magee,  eoae 
combination  of  these,  or  eoMething  else  altogether?  Should  the  organization 
of  the  conceptual  structure  be  a net  uith  no  constraints  on  linkage,  or  a 
highly  etructured  hierarchy,  or,  again,  something  else?  Since  no  component  to 
do  understanding  has  been  implemented  here,  My  ansuere  to  these  queetione  Mill 
have  just  enough  specification  to  motivate  other  choices  that  must  be  made  in 
the  system. 

For  the  proposed  deductive  component,  meaning  can  be  defined  In  terMe  of 
certain  eyMbole,  data  structures,  and  programs.  Entries  in  the  conceptual 
"tructure  are  theorems  and  assertions  in  a deductive  programming  language  like 
Planner  (18)  or  Conniver  (25).  For  the  most  part,  these  are  either  directly 
or  indirectly  associated  uith  entities  called  concept  markere.  U I thin  the 
system,  the  concept  markere  are  primitives:  assertions  in  the  deductive  data 

base  are  built  from  them  and,  ao  mentioned,  theorems  are  associated  uith  them. 
It  ie  easy  to  imagine  another  level  in  the  eystem  uith,  say,  visual  images. 

The  concept  markere  uould  then  point  to  theee  images,  and  procedures  uould  be 
available  to  do  operations  on  them  like  inspection,  updating,  simple 
manipulations  I ike  rotation,  etc. 
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The  chaptar  that  follows  it  concarnad  Mith  the  May  concept  aarkere  should 
be  ordered,  and  chapter  5 goes  into  sore  detail  on  the  kind  of  processing  ue 
Mould  expect  froa  a deductive  coaponent.  The  ideas  diecueeed  here  are  not 
original,  but  I think  thia  chapter,  end  chaptar  5,  Mill  be  helpfui  in 
describing  soae  of  the  issues  that  have  to  be  considered  if  the  other  parte  of 
the  eyotea  are  ever  to  interact  successfully  ulth  a deductive  coaponent. 


3.2  Objects,  Relations,  and  Properties 

As  in  Uinograd’s  systea,  the  things  in  the  uorld  uill  be  represented  ae 
objects,  relations,  and  properties.  Note  that  these  three  categories  uill  be 
used  froa  nou  on  only  as  distinctions  uithin  the  conceptual  structure,  not  to 
r.aae  things  in  the  real  uorld.  To  an  extent,  I aa  Milling  to  consider  theee 
three  categories  as  priaitives,  since  it  is  difficult  to  coae  up  uith  Mater- 
tight  definitions.  As  an  atteapt,  however,  let  us  say  that  the  process  of 
creating  a conceptual  object  effectively  differentiates  the  part  of  the  uorld 
to  uhich  it  corresponds  froa  the  rest  of  experience  (uith  experience  and  uorid 
viewed  broadly  - not  just  reality  but  laaginary  experiences,  etc.  as  ue II). 

An  object,  then,  po’nts  to  (or,  less  aetaphor ical  ly,  represents)  anything 
vieued  statically,  that  is,  any  phenoaenon  considered  as  an  entity.  An  object 
aight  be  a physical  object  like  STRUCK,  an  institution  like  0CITY-HALL,  a 
aental  f henoaenon  like  a 0DREAM,  soae  abstract  entity  like  0TRUTH,  etc.  The 
sharp  iign  here  is  used  to  distinguish  concept  aarkers,  uhich  are  part  of  the 
•gates’ s internal  conceptua1  structure,  froa  plain  uords,  uhich  are  part  of 
languaye. 

A relation  binds  one  or  sore  entities,  the  exact  type  of  linkage 
depending,  of  course,  on  the  type  of  relation  invoived.  The  entities  bound 
aay  theaselves  be  relations,  aay  be  objects  or  properties,  or  nay  be  soae 
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combination  of  the  three.  One  common  type  of  relation  is  an  event;  events 
always  involve  a specific  point  or  span  of  tine  in  addition  to  their  other 
participants.  Properties  are  relations  with  no  arguments.  This  is  the  only 
way  that  properties  distinguish  themselves  from  other  relations,  but  the 
distinction  seems  to  be  a useful  one  both  conceptual  .y  and  for  purposes  of 
implementation.  Properties  are  used  to  describe  and  modify  objects  and 
relations,  as  well  as  other  properties.  To  represent  this,  the  system  has  a 
special  relation  (called,  not  surprisingly,  /WAVE-PROPERTY) , which  links 
properties  with  the  concept  modified. 

Our  three  conceptual  categories  correspond  roughly  to  the  jobs  of 
different  syntactic  utructures:  noun  groups  often  refer  to  objects;  clauses, 
preposition  groups,  and  some  adjective  groups  represent  relations;  and  most 
complement  and  attribute  adjective  groups  represent  properties.  This 
correspondence  should  not  be  taken  to  imply  that  objects,  relations  and 
properties  are  derivable  from  syntactic  categories.  The  conceptual  structure 
is  an  independent  level  in  fact  it  is  nnt  surprising  to  eee  high  level 
semantic  distinctions  reflected  in  the  syntax  of  at  least  English  and  German, 
and  probably  all  languages. 


3.3  Selection  Restrictions 

Considering  the  huge  classes  formed  by  classifying  the  world  into 
objects,  properties  and  relations,  it  seems  lively  that  particular  elements 
will  be  more  useful  and  accessible  if  the  classes  are  structured  in  some  way. 
Since  any  choice  of  structure  should  be  influenced  by  function,  let  us  look  at 
the  way  the  ey»'.em  will  want  to  use  information  about  the  world.  Basically, 
there  are  two  kinds  of  activities  that  we  want  happening  in  the  syetem.  One 
is  the  use  of  semantic  selection  restrictions  to  eliminate  incorrect 
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interpretations.  The  other  ie  the  uae  of  the  full  range  of  real-world 
inf  creation  to  lake  a final  ciwlca  between  interpretations,  including 
determining  pronoun  reference,  etc.  These  two  functions  Make  different 
demands  in  terms  of  the  kinds  of  knowledge  structure  that  each  can  use  aoet 
easily,  so  a decision  on  structure  requires  a closer  look  at  semantic 
restrictions  and  deductive  interpretation. 

Selection  restrictions  indicate  the  outer  limit  on  what  types  of 
concepts  may  appear  in  a relation  together.  For  example, 

□as  StQck  Seife  ist  I i ebevo 1 1 . 

The  bar  -?f  snap  is  affectionate. 

is  an  odd  sentence  because  affection  is  an  attribute  of  humane,  maybe  of 
animals  too,  but  it  certainly  can  not  be  an  attribute  of  a non-living  thing. 

j ■ 

(This  ignores,  of  course,  personification,  but  this  phenomenon,  as  well  as  any 
sort  of  metaphorical  speech,  will  not  be  considered  now.  See  section  S.8  for 
a discussion  of  some  of  the  issues  involved.)  From  thie  example,  we  want  the 
selection  restriction  associated  with  affectionate  to  be  ALIV1NG-THING.  Such 
a seinction  restriction  gives  us  a criterion  for  rejecting  bad  parses.  If  the 
semantic  component  ever  finde  itself  trying  to  Mnk  affection  to  soap  in  a 
straight  scientific  text,  it  will  find  no  possible  meanings  of  I i ebevo  1 1 that 
will  satisfy  the  selection  restriction.  Semantics  will  then  fail,  which  will 
caus'  the  syntactic  component  to  try  another  parse. 

In  addition  to  rejecting  a parse  because  no  meanings  of  a word  are 
acceptable,  the  semantic  component  could  also  use  selection  restrictions  to 
eliminate  poss'ble  meanings  of  a word.  This  does  actually  happen,  but  it  is  a 
rather  tricky  business.  For  example,  we  might  expect  that  selection 
restrictions  could  help  us  out  in  distinguishing  between! 
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(i)  Oer  Film  sd i e I t heuts  Aband. 

The  file  ie  d I au i no  tonight. 

(ii)  Unter  Lichtreiz  aoielen  die  Chroma tophoren. 

The  chroma tophoree  olau  when  stimulated  by  light. 

For  the  meaning  of  the  verb  so i e I en  in  (i)  us  might  specify  that  the  first 
argument  of  the  relation  ehould  be  something  like  //THEATRICAL-PRESENTATION, 
i.e.  a film,  play,  puppet  ehou,  cabaret,  etc.  It  uould  not  be  unreaeonable  to 
expect  the  eemantic  markers  for  these  phenomena  to  be  claesified  under 
^THEATRICAL -PRESENTATION.  For  (ii),  houever,  it  i*  hard  to  eay  what  the  flret 
argument  might  be.  The  I ; ghte  on  a marquee  can  play  in  this  eense,  the 
Northern  Lights  can,  chroma tophoros,  of  course,  do  - even  sounds  can.  The 
unifying  characteristic  here  seems  to  be  that  these  things  form  a eyetem, 
whose  individual  members  perform  their  particular  activity  (flash,  emit  a 
eound,  move  etc.)  in  an  apparently  (to  the  perceiver)  random  order.  Thie  ie 
obviouely  not  a simple  characteristic,  and  probably  the  best  we  can  do  for  a 
selection  restriction  here  is  somathing  very  genoral  like  0COfCRETE.  Since  a 
thing  that  is  a //THEATRICAL -PRESENTATION  uould  also  be  claesified  under 
//CONCRETE,  if  ue  are  given  sentence  (i),  selection  reetrlctions  alone  will  not 
be  able  to  tell  us  uhether  the  film  is  running  at  the  theater,  or  uhether  ue 
should  expect  to  ees  it  flashing  on  and  off.  For  thie  reason,  although  the 
selection  restrictions  in  the  system  do  resemble  the  semantic  markers  of  Fodor 
and  Katz  (6),  they  eervs  a different  purpose,  in  thie  system,  the  eelection 
restrict ione  are  not  expected  to  give  a full  account,  or  even  the  major  part, 
of  the  meaning  of  a uord.  Something  as  simple  as  a selection  restriction  will 
not  be  able  to  represent  semantic  constraints  as  to  uhich  participants  may 
take  part  in  uh'u'i  relatione  with  any  degree  of  accuracy.  Uhat  a eelection 
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restriction  can  offer  is  a negative  criterion  for  eliminating  impossible 
interpretations.  In  this  uag  they  can  be  quite  useful  for  giving  feedback  to 
the  parser,  and  sometimes,  but  not  always,  they  can  be  helpful  in  eliminating 
impossible  interpretations  of  a word. 

More  detail  on  hou  selection  restrictions  are  used  will  be  given  in  the 
next  chapter.  Based  on  the  discussion  so  far,  housvsr,  ue  night  predict  that 
selection  restrictions  can  be  made  to  work  most  efficiently  with  a strictly 
hierarchical  structure.  A single  tree  has  been  used  for  seiectional 
restriction  processing,  with  the  relation  betueen  levs  Is  on  the  tree  the 
general  one  of  claes  membership.  Note  that  3 single  classification  scheme  ie 
not  the  only  choice  for  selection  restrictions.  Multiple  trees  are  a 
possibility,  as  in  Uinograd,  Operations  on  a single  tree,  however,  can  be  done 
with  a minimum  of  time  and  effort,  and,  since  the  reason  for  using  selection 
restrictions  is  efficiency,  it  seems  to  be  the  best  choice. 

The  selection  restriction  tree  should  be  organized  to  eliminate  the 
largest  number  of  interpretations  as  often  as  possible,  but  beyond  thie  goal 
the  organization  issue  seems  to  be  a question  of  balance  and  a matter  of 
taste.  Civen  a constant  number  of  concepts,  less  depth  means  a faster  search, 
more  depth  means  that  the  selection  restrictions  can  make  finer  distinctions. 
The  feature  that  is  essential  here  is  the  hierarchical  structure.  Thus,  our 
tree  might  have  a top  node  labeled  AUORLD,  whose  three  descendants  are 
AQBJECT,  ^RELATION,  and  APROPERTY.  The  upper  nodes  of  the  relation  subtree 
are  shown  In  Figure  3.1.  Here,  ASTATIC-RELATION  includes  things  like  spatial 
relations,  relations  of  comparison  (X  is  similar  to  Y),  etc.  AMENTAL-PROCESS 
includes  intellectual,  emotional,  end  perceptual  processes.  (This  organization 
is  taken  from  Halliday  (16).)  Figure  3.2  shows  the  upper  nodes  of  the  property 
eubtree.  The  AMANNER-PROP.  ASPATIAL-PROP,  and  ATEMPORAL-PROP  classes  contain 
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Figure  3.1 
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Figure  3.2 

properties  that  answer  the  questions  "how",  "where"  and  "when". 

DIQUANTIFICATION  deals  with  extent,  which  is  either  nusber,  for  objects,  or 
intensity,  for  relations.  AIIOENTI TY-INTEGRI TY  contains  properties  like 
wholeness  and  uniqueness,  while  DIPERCEPTUAL  deals  with  any  properties  that  can 
be  detected  by  the  senses.  Note  that  this  property  classification  ie  not 
exhaustive,  but  it  dose  give  an  idea  of  the  organization  of  the  tree.  A 
larger  section  of  the  tree  used  in  the  systea  appears  in  Appendix  C. 

3. A Structuring  the  Uorld  for  the  Deductive  Cosponent 
Since  the  selection  restrictions  can  provide  only  negative  Inforaation, 
we  would  also  like  a finer-grained  check  to  reject  the  rest  of  the  possible 
interpretations.  There  should  be  sose  positive  criteria,  so  that  we  can  begin 
to  know  that  our  choice  aakes  sense.  For  this  we  need  the  full  power  of  a 
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deductive  suttee,  The  question  us  are  working  on  It  how  the  data  bate  and 
theoreae  of  the  deductive  eyetee  should  be  organized.  For  a start,  the 
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classifications  used  by  the  selection  restrictions  look  useful.  Note, 
however,  that  in  one  context  Figure  3.3  eight  be  a useful  classifications 
scheee  for  objects,  while  another  context  eight  favor  Figure  3.4.  Even  given 
the  sane  general  context,  i.e.  biology,  psychology,  cheeistry,  or  the 
superearket,  eany  different  ciassif icatory  scheees  are  possible.  Ue  want  eore 
than  just  a single  classification  schsas  for  the  general  data  base,  so  the 
structure  ueed  wi i i be  a group  of  trees.  Actually,  since  the  trees  are  not 
coepleteiy  disjoint,  ue  can  esrge  thee  into  a single  lattice  structure.  Doina 
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thie  to  the  two  ciassif  icetions  above,  ue  would  get  the  ciassi  f i cat  ion  ehown 
in  Figure  3.5. 

What  does  the  hierarchical  etructure  of  the  deductive  data  baee  bug  ue? 
Firet,  the  Motivation  for  hierarchy  ie  econoey  of  definition.  An  0OCTOPUS  ie 
an  0ANIHAL  which  ie  a 0LIVING-THING  which  ie  ^CONCRETE  which  eakee  it  an 
0OBJECT.  Uithout  a hierarchical  etructure,  we  would  be  epecifging,  for 
example,  that  octopueee  have  eoMe  Mechanise  of  locoMotion  (property  of  being 
an  0ANIMAU,  that  they  have  soae  sort  of  reproductive  eysteM  (property  of 
being  a M.IVING-THING) , that  they  are  perceivable,  although  poeeibly  aided  by 
inetruaents  (^CONCRETE) , and  that  they  are  entities  rather  than  proceeeee  or 
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Figure  3.5 
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attributes  (property  of  being  an  ^OBJECT).  All  this  uould  be  associated  with 
#0CT0PUS,  and  much  of  the  ease  uould  have  to  be  duplicated  for  #H0RSE, 

0SEAGULL,  and  the  rest.  So  from  hierarchy  ue  get  economy  of  storage. 

In  thinking  about  the  system,  1 have  limited  myself  to  a single  context 
and  a single  static  hierarchy  to  avoid  the  difficulties  inherent  in  adding  to. 
deleting  from,  and  reorganizing  conceptual  structures.  These  are  interesting 
but  major  problems,  related  as  they  are  to  processes  like  learning, 
hypothesizing,  and  shifting  from  one  context  to  another.  A working 
translation  system  uould  require  a knowledge  structure  of  considerably  greater 
flexibility  than  the  one  outlined  here. 

It  should  be  mentioned  in  passing  thr.  neither  hierarchical  organization 
nor  word  definitions  themselves  automatically  imply  dl  t ims  uith 
borderline  cases.  Say,  for  instance;  that  the  criterion  for  *1  lying  thing"  is 
self-reproduction.  If  viruses  reproduce  themselves  but  for  other  reaeone  ue 
are  reluctant  to  call  them  living  things,  then  this  is  a dilemma  only  if  a 
single  defining  property  is  all  that  ue  allow  ourselves.  In  fact,  it  is 
possible  to  set  up  a group  of  borderline  categories  defined  by  appropriate 
mixtures  of  properties  from  the  major  categories. 

The  hierarchical  order  alone,  however,  needs  supplementing,  sines  ue 
uould  like  to  be  able  to  explicitly  represent  other  ordered  relationships 
between  concepts.  Ths  additional  structures  to  be  Introduced  ui  i I lead  us  to  a 
general  graph  structure  uith  no  self-loops,  but  the  presence  of  our  underlying 
hierarchical  structure  ui 1 1 constrain  and  control  the  finished  result.  Since 
the  lexicon  is  going  to  be  interacting  rather  actively  uith  the  conceptual 
structure,  it  might  help  to  look  at  the  situation  for  words  before  any 
additions  to  the  structure  are  made. 
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3.5  The  Relation  of  Uords  to  Concepts 

There  are  several  nays  of  approaching  the  problem  of  ujrd  definitions.  A 
word  might  be  defined  in  terms  of  a class  and  some  number  c * attributes.  Thie 
eort  of  formulation  is  an  old  one  - "genus"  and  "differentia"  are  the 
classical  terms  - and  ths  standard  form  of  a dictionary  definition  shout  that 
it  is  a familiar  one:  an  octopus  is  "any  of  a group  of  molluske  having  a eoft, 
sad  ike  body,  a large  head  uith  a mouth  on  the  undersurface,  and  eight  arms 
covered  uith  suckers."  Here,  the  phrase  up  to  "molluske"  represents  the  genus 
and  then  the  differentiae  follow.  As  their  name  implies,  the  differentiae 
offer  criteria  for  distinguishing  between  different  uords  defined  uith  reepect 
to  the  same  conceptual  class.  A definition  like  this  could  be  used  in  a 
learning  (i.e.  non-static)  structure,  and  it  presupposes  a top-duun  learning 
process.  The  genus  is  aseumed  knoun  and  the  differentiae  give  distinguishing 
characteristics  for  the  new  node  that  is  added.  (In  actual  practice,  the 
differentiae  may  ha  used  to  pick  out  a concept  uhich  is  already  knoun.  In 
this  case  both  genus  and  differentiae  are  knoun,  and  the  problem  is  merely 
learning  a new  word  for  an  already  familiar  concept.) 

This  genus-differentia  type  of  definition  might  have  its  place  in  a 
system  with  learning  capabilities,  although  It  would  not  be  a fundamental 
place,  since  a simple  top-down  process  can  not  adequately  model  a good  part  of 
the  learning  that  we  see  people  doing.  Since,  however,  I am  not  considering 
issues  of  learning  at  all,  definitions  will  tane  a different  form.  The 
knouledge  data  base  ie  assumed  to  be  static  in  the  senee  that  for  the  uorde 
defined  one  or  more  nodes  (i.e,  concept  markers)  are  always  present  in  the 
conceptual  structure.  Furthermore,  the  differentiae  - those  bundles  of 
information  that  distinguish  a concept  from  other  members  of  its  clase  - are 
also  presumed  to  be  in  the  data  base  already.  Therefore,  a word  can  be  moet 
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easily  defined  by  ''eference  to  ths  concept  node  or  nodes  it  represents,  and  so 
uords  can,  in  a sense,  be  "plugged  in"  to  the  conceptual  structure.  Since  the 
system  already  knous  about  the  concepts  represented  by  the  restricted  number 
of  uords  »t  encounters,  no  conceptual  restructuring  is  going  to  be  necessary. 

The  fact  that  a uord  can  be  "plugged  in"  in  thie  manner  means  that  uords 
are  ordered  uith  respect  to  the  conceptual  structure.  Note,  houever,  that  not 
all  conceptual  distinctions  need  be  reflected  lexically;  that  is,  some  concept 
markers  might  have  no  uords  defined  for  them.  This  makes  sense  if  you  think 
of  sensory  impressions;  natural  language  vocabulary  does  not  begin  to 
approximate  the  number  of  different  shades  of  color  that  can  be  distinguiehed 
and  remembered,  or  the  number  of  sounds  or  tastes, 

3.6  Fields 

Uith  uords  in  place,  it  is  tine  to  go  back  to  an  unsolved  problem.  The 
conceptual  structure  displayed  similarities  and  differences  betueen  members  of 
a class,  but  ue  have  no  uay  of  ordering  either  the  members  of  a single  class 
or  members  of  different  classes  among  themselves.  A phenomenon  like  uord 
contrasts  suggests  that  something  like  this  is  needed.  One  alternative  is  to 
order  the  descendants  of  a concept  node,  but  if  more  than  one  criterion  is 
relevant,  bookkeeping  could  become  annoying.  And,  of  course,  this  does  not 
even  address  the  similar  problem  of  ordering  nodes  from  different  classes. 

The  solution  proposed  is  the  introduction  of  a linguistic  field.  The  term 
"linguistic  field"  is  not  neu;  for  a discussion  of  its  history,  see  Robins 
(31,  p.81).  On  the  basis  of  uhat  ue  have  developed  so  far,  the  field  should 
be  an  ordering  of  object,  relation,  or  property  concepts  using  a property  as  a 
criterion.  Ue  do  not  uant  t-j  think  of  a field  as  ordering  uords,  since  the 
ordering  here  is  semantic  and  thus  strictly  speaking  should  not  deal  uith  the 
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words  themselves. 

To  represent  word  contrasts,  ue  could  use  + and  - at  the  extreme  ends  of 
a field.  One  special  sort  of  U*.  m^ber  field  represents  the  case  where  the 
elements  exhaust  the  domain  of  the  field's  property,  for  example  the  case  of 
negatives.  (There  need  not  be  any  middle  ground  between  "big"  ard  "not  big", 
where  the  criterion  of  size  applies.)  Antonyms  present  an  interesting 
situation.  Take,  for  example,  "good"  and  "bad".  (Here,  and  in  the  next  few 
sections,  I will  use  English  examples,  since  the  issues  discussed  seem  to  be 
independent  of  the  language  involved.)  Host  people  would  call  "good"  and  "bad" 
opposites,  and  so  their  associated  concept  markers  are  alloted  a two-membe; 
field  along  a property  like  flUORTH.  But  what  happens  when  ue  expand  the 
context  to  include  "great",  "excellent”,  and  "lousy"?  Uith  respect  to  theee, 
"good"  and  "bad"  unJergo  a subtle  shift  in  meaning  and  are  no  longer  the 
absoiutes  for  which  ue  constructed  the  two-member  field.  Such  word  paire  can 
be  called  polysystemic.  Ue  therefore  need  one  or  more  additional  fields  for 
the  different  frames  of  reference,  and  ths  process  of  interpreting  a word  may 
entail  deciding  which  field  is  re'evant  for  ths  particular  usage.  The 
implementation  derails  for  fields  seem  to  depend  on  the  way  knowledge  ul  1 1 be 
structured  in  ths  system,  so  fields  will  not  be  considered  further  here. 

3.7  Synonymity  and  Connotation 

In  terms  of  the  conceptual  structure  we  have  been  describing,  synonymity 
can  be  defined  as  the  relation  that  holds  between  words  that  share  the  ecme 
associated  concept  rarker.  Given  a set  of  synonyms,  the  present  structure  can 
therefore  represent  their  similarity!  the  next  step  is  to  look  into  ways  to 
represent  their  differences.  Ths  first  question  to  ark  Is  whether  there  m.  let 
any  pairs  of  words  that  are  interchangeable  in  every  case.  Consider,  for 
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example,  the  uords  fel  ine  and  cat.  That  these  are  synonyms  is  exhibited  by 
the  fact  that  a person  Mould  bs  Milling  to  use  either  te  denote  the  etandard 
furry  animai  with  four  legs  and  whiskers.  Fel  ine.  however,  is  a more  formai 
word  and  one  whose  usage  wouid  tend  to  be  restricted  to  scientific  or  poetic 
contexts;  cat  is  a general  purpose  word.  The  distinction  here  ie  the  famiiiar 
one  between  connotation  and  denotation.  In  generai,  one  would  want  to  cal  i 
denotaticn  ie  conceptual  meaning  of  a word  - what  we  have  been  taiking  about 
so  far  - and  connotation  the  phenomenon  associated  with  the  uee  of  the  word 
iteelf.  Connotation  tells  us  about  ihe  frame  of  reference  in  which  a word  ie 
being  used  and  gives  infori  ation  about  the  speaker.  The  properties  formai  or 
informal,  archaic  or  modern,  educated  or  uneducated,  objective  or  biased,  are 
some  aepecte  that  might  enter  into  the  connotation  of  a word.  Language 
exhibits  such  economy  in  other  areas  (e.g.  German  nominal  deciension,  eee  Frey 
(7))  that  it  would  be  surprising  to  find  extravagance  at  the  lexicai  level. 
Thue,  it  seems  unlikely  that  there  are  two  uords  within  a language  that  are 
completely  equivalent.  Ue  have  a pair  of  words  - ml  and  feline  - that  seem 
virtually  interchangeable  with  reject  to  denotation.  The  difference  comes, 
of  course,  at  the  level  of  connotation,  and  ii  seems  that  this  wi  i i be  the 
caee  for  all  eynonyms. 

To  get  this  new  connotation  information  into  the  model,  ue  introduce 
another  sort  of  field.  Thie  field  Cakes  synonymous  words  and  orders  them 
along  properties  like  formality,  technical  i ty,  etc.  The  definitions  in  the 
ayetem  use  only  binary  properties,  i.e. , +-  formal,  ^-technical , etc.  In 
another  -ayetem  that  deals  with  a wider  context  and  has  a richer  vocabulary,  I 
suepect  that  one  would  want  greater  expressive  freedom  than  Ie  given  by  binary 
categories. 
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3.8  Choosing  Concept  Marker s 

in  the  chapter  so  far,  us  have  discussed  the  uay  concept  Markers  ehould 
he  ordered,  but  there  ha*  been  no  ind*  'ion  of  hou  they  ehould  be  choeen.  In 
fact,  it  is  not  at  all  clear  uhat  a set  of  ssMantic  Markers  should  look  like, 
because  they  are  used  in  the  syeteM  by  More  than  one  coaponent.  Structures 
built  from  concept  Markers  are  of  central  importance  in  the  syetem,  eo 
although  the  follouing  discussion  gsts  ahead  of  the  exposition,  I think  it  is 
important  to  stop  and  consider  soae  of  the  iosues  involved  in  choosing  concept 
markers. 

For  each  sentence,  the  semantic  component  will  construct  a semantic 
represent  tion.  This  uill  be  built  from  concept  markers  supplied  by  uord 
definitions  and  the  semantic  specialist  rout'nec  themselves.  After  a semantic 
representation  has  been  constructed  for  a sentence,  its  component  concept 
markers  uill  be  used  to  call  deductive  routines  associated  uith  them.  It  is 
the  job  of  the  deductive  component  to  pick  the  most  likely  representation  and 
ship  it  over  to  the  generator.  The  generator,  in  turn  uill  use  the  semantic 
representation  to  produce  English,  and,  for  this,  the  English  dictionary  ie 
ordered  so  that  uords  are  associated  uith  semantic  markers  or  groups  of 
semantic  markers.  The  concept  markers,  then,  have  a fourfold  roles  in  source 
language  definitions,  in  target  language  definitions,  in  the  semantic 
representation,  and  in  the  deductive  data  base.  (A  closer  look  at  a fifth 
role,  that  of  selection  restrictions,  is  deferred  until  the  next  section.) 

Given  the  various  roles  played  by  the  semantic  markers,  let  us  ccnsider 
the  choice  of  a dictionary  definition  for  the  German  verb  brechen  ("to 
break"),  as  used  in  the  example: 

Fritz  brach  das  Fenster.  / Fritz  broke  the  uindou. 

First,  ue  could  use  a special  semantic  marker  0BREAK  uith  a standard 
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definition  procedure  for  relatione  (eee  section  4.2.1).  Thie  definition  mi  1 1 
be  compact,  eaeg  to  write,  and  easy  for  a person  to  read.  On  the  other  hand, 
the  marker  #BREAK  is  a rather  high  level  one,  and  we  might  chooee  instead  to 
write  the  definition  in  a special  form,  writing  a routine  to  build  a chunk  of 
eemantic  representation  from  the  three  markers  0CAUSE,  ^BECOME  and  0BROKEN. 

Note  that  the  issue  ie  more  than  just  a question  of  size  of  primitive  set 
versus  eaee  of  expression.  A representation  using  0BREAK  is  extremely 
language  dependent;  this  Is  of  dubious  merit  in  general,  and  particularly  eo 
when  we  are  dealing  with  two  soparate  languages  in  a tingle  eyetem.  The 
generator  takes  the  semantic  representation  to  be  fully  unambiguous,  and 
expects  to  be  able  to  generate  from  it  without  further  calls  to  the  deductive 
component  (except  in  certain  special  cases  which  will  be  dlscuseed).  The 
segments  of  the  semantic  representation  must  therefore  be  sample  (low-level) 
enough  so  that  no  information  ie  missing  when  the  semantic  representation 
reaches  the  generator. 

Ore  possible  solution  might  be  to  use  the  eemantic  representation  only 
for  deduction,  it  might  therefore  contain  very  high  level  components  and  be 
unabashedly  source- language  dependent.  Deduction,  then,  would  not  be  chooeing 
between  representations,  but  rather  constructing  its  own,  much  lower-level 
representat ior  to  be  passed  on  to  the  generator.  This  low-level 
representation  would  try  to  approximate  language- independence,  in  the  sense 
that  it  would  aim  to  be  input  for  a generator  of  any  language. 

The  approach  sketched  seems  like  a good  solution,  in  that  eource  language 
dictionary  definitions  could  be  compact  and  uniform,  wnMe  at  the  same  time  no 
information  would  be  lost  on  the  way  to  the  generator,  i did  not  choose  it 
for  two  reasons.  First,  a low  level  representation  causes  problems  with 
target  language  definitions.  Uith  a lower  level  semantic  representation,  a 
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large  number  of  target  language  definitions  would  involve  aeeociating  piecee 
of  the  semantic  representation,  instead  of  just  a single  marker,  with  worde. 
Thie  is  a pattern  matching  problem  that,  given  a large  numb  .r  of  words,  could 
elow  down  the  generation  process  intolerably  (at  least  given  current  memory 
archi  tecture),  in  addition,  note  that  the  (0CAUSE  X (0BECOHE  Y ^BROKEN)) 
repreeentat ion  of  fere  no  clear  advantages  for  organizing  the  deductive  data 
baee.  The  kernel  of  meaning  associated  with  CAUSE  may  not  vary  from  one 
situation  to  another,  but,  as  the  participants  change,  the  nature  of  the 
caueal  relation  may,  as  well.  For  example,  compare  the  CAUSE  in  "Jay  brpke 
the  mirror"  with  the  causality  involved  in  "Erwin  popped  the  popcorn."  The 
actions  associated  with  causing  breakage  are  hitting,  dropping,  etc.  To  cause 
corn  to  pop,  on  the  other  hand,  involves  putting  a pan  of  it  over  eome  heat 
source.  Uhat  1 am  trying  *o  get  at  here  ie  that  with  a low  level 
representation,  information  used  in  deduction  still  would  have  to  be 
associated  with  combinations  of  concepte,  i.e.  higher  levels. 

Because  of  the  cone  i derat  ions  mentioned,  in  the  system  semantic  markere 
are  choeen  as  the  union  of  different  word  boundaries,  if  something  can  have 
two  different  lexical  representations  in  German  be.  in  English  (exclusive  of 
connotation  differences,  that  is),  the  louer  level  representation  ie  choeen. 
For  example,  kennen  and  wissen  ("to  know")  wind  up  with  the  two  semantic 
markers  0KNOU-A-FACT  and  #KN0U -A -PERSON,  while  gale  and  wind  (in  German, 

Hind)  get  the  two  markers  CALE  and  0UIND.  Uith  thie  sort  of  organization, 
the  deductive  component  is  given  basically  a selective  role,  and  only  adde  to 
the  3emantic  representation  it  ie  given  by  filling  in  certain  slote  left  open 
by  the  semantic  specialist  routines.  The  semantic  representations  generated 
from  theee  semantic  markers  have  no  c.«im  at  all  to  language  independence,  but 
the  lose  in  generality  is  compensated  for  by  faster  generation. 
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3.9  Uhen  to  Use  a Restriction 

. Uhen  using  concept  Markers  as  selection  restrictions,  it  is  i sport  ant  * • 
remember  that  they  give  only  partial  information.  If  used  in  a syetea  Mhere 
Multi-category  definitions  and  restrictions  also  exist,  the  seaantic  Marker 
restrictions  are  actually  redundant.  One  justification  for  this  redundancy  is 
efficiency,  as  discussed  earlier  in  the  chapter.  Another  attraction  of  the 
concept  Marker  restrictions  is  that  they  are  an  easy  uay  to  get  a handle  on 
semantics  - In  fact  one  of  the  feu  uays  that  ue  know  - without  getting 
entangled  in  a large  and  coaplax  web  of  real-world  knowledge.  Selection 
restrictions,  then,  look  like  a proeialng  uay  to  use  eeaantlee  to  guide  the 
parse. 

The  first  version  of  ay  *yeteM  did  use  selection  restriction  inforaatlon 
to  guide  the  parse,  although  only  to  a very  I lai  ted  extent.  Thie  was  in  the 
routine  that  parnes  verb  objects!  if  the  verb  had  been  found,  ite  restrictions 
were  checked  to  see  if  they  Included  a location,  a Manner,  or  soae  other 
property.  If  thie  was  the  case,  prepositional  phrases  and  adverbs  were 
checked  to  aake  sure  that  at  least  one  of  these  fit  the  seaantic  requireMsnt. 
If  this  were  not  the  case,  then  special  action  could  be  taken,  like  checking 
other  syntactic  coaponents  to  see  if  they  had  absorbed  a preposition  by 
Mistake.  This  was,  of  course,  only  llaited  use  of  seMantlce  to  guide  the 
parse,  but  it  was  In  an  area  where  s lot  of  help  is  obviously  needed,  naaely 
binding  of  adverbial  Modifiers. 

In  the  Most  recent  version  of  the  eysteo,  the  parser  does  not  use 
selection  restrictions  in  this  way.  This  decision  was  prlaarlly  Motivated  by 
Geraan  word  order.  As  was  Mentioned  in  chapter  2,  for  English  clause 
structures,  the  aain  verb  precedes  its  objects.  Me  can  therefore  access  the 
verb’s  restrictions  and  use  thee  to  look  for  or  evaluate  objects.  In  Geraan, 
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however,  only  some  main  clauses  have  a eubject-verb-ob jecte  word  order,  while 
secondary  clauses  are  usually  ordered  subject-objects-verb.  In  addition,  any 
main  clause  uith  an  auxiliary,  modal,  or  passive  verb  structure  will  aleo  have 
its  main  verb  at  the  end.  Since  using  selection  reetrictione  to  guide  the 
parse  requires  a certain  amount  of  structure  (to  handle  multiple  definitions, 
optional  objects,  and  variations  in  word  order),  the  investment  in  programming 
etfort  seemed  to  promise  less  return  for  German  than  it  does  for  English. 
Selection  restrictions  are,  of  course,  still  part  of  the  system,  but  they  are 
used  exclusively  by  the  semantic  component  to  eliminate  impossible  semantic 
representations. 

!n  the  current  implementation,  semantic  reetrictione  are  hung  on  the 
concept  markers  as  LISP  properties.  Since  the  markers  have  an  explicit  tree 
ordering,  the  restrictions  need  not  be  associated  uith  each  semantic  marker, 
but  may  instead  be  tacked  onto  the  highest  node  for  uhich  the  restrictions 
hold.  This  saves  space,  although  of  course  at  the  expenee  of  the  email  amount 
of  time  it  may  take  to  trace  up  the  tree  to  fetch  restriction  lists. 

In  this  chapter  ue  have  made  some  decisions  about  the  ordering  of  concept 
markers.  First,  concept  markers  were  divided  into  objects,  relations,  and 
properties.  Two  main  orderings  wers  presented:  a tree  to  implement 
belectional  restrictions  and  a lattice  as  a primary  ordering  for  deduction.  A 
secondary  ordering  uas  provided  by  fields,  to  relate  concept  markere  to  each 
other  along  a dimension.  Uords  were  ordered  by  virtue  of  their  aseociation 
uith  concept  markers  and  according  to  their  connotations.  The  static, 
strictly  hierarchic  concept  marker  ordering  proposed  here  uould  not  be 
adequate  for  a working  translation  system;  houever,  the  conceptual  etructure 
is  nou  uell  enough  specified  that  us  can  go  on  to  describe  the  semantic 
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Chapter  4 — Semantic  Processing 
4.1  An  Overview 

4.1.1  The  Semantic  Component 

In  the  last  chapter  we  considered  a static  semantic  structure,  but  we 
have  not  get  discussed  how  a particular  sentence  relates  to  this  general 
framework.  In  this  chapter  and  the  newt,  I will  trg  to  remedy  that  eituation. 

As  soon  as  the  German  grammar  has  successfully  parsed  some  section  of  the 
sentence,  the  semantic  routines  are  called  in.  Their  job  le  to  construct  a 
semantic  representation  for  each  possible  interpretation  of  the  eentence.  In 
many  placee,  the  shape  of  a semantic  representation  might  parallel  the  paree 
tree,  but  at  other  points,  the  divergence  will  be  obvious.  Uhere  the  paree 
tree  is  a record  of  syntactic  relations,  the  semantic  representation  is  an 
independent  structure  to  record  semantic  relations  that  are  both  implicit  and 
explicit  in  a sentence.  The  highly  structured  semantic  representation 
reflects  systematic  linguistic  phenomena  and  it  is  a step  on  the  way  from  the 
syntactic  representation  to  the  body  of  information  that  would  be  invoked  by 
the  deductive  component. 

The  genera!  organization  of  the  semantic  component  follows  Uinograd’e 
system,  although  there  have  been  some  fairly  high  level  changes.  In  the 
translation  system,  the  semantic  representation  itself  piays  a prominent  role. 
Uhereas  in  SHROLU  the  representation  is  essentially  an  intermediate  step  in 
the  process  of  building  theorems  for  deduction,  here  It  Is  also  important  as 
the  input  to  the  generator.  To  use  the  semantic  representation  in  thie  way,  I 
have  mads  a number  of  additions  in  terms  of  the  information  it  contains, 
especially  in  the  direction  of  a more  systematic  treatment  of  thematic 


features  (section  4.9). 
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Uhere  poMible,  word  definition  types  have  been  standardized,  eo  that  the 
Individual  word  procedures  can  be  ueed  descriptively  ae  well  as  leperatl vely. 
That  Is,  the  definitions  can  be  exaalned  by  the  seeantlc  coeponent,  which  can 
then  take  any  appropriate  actions  before  executing  the  procedure.  A aschanlea 
has  also  been  added  to  handle  partial  inforeatlon  In  an  orderly  fashion  (the 
MJNBOUND  Marker t see  section  4.7.1).  The  seeantic  coeponent  can  add  a 
relation  to  the  representation  before  ell  Its  arguMents  are  bound,  and  then 
return  to  add  the  arguaents  of  the  relation  ae  they  are  encountered. 

The  chapter  that  follows  contains  a great  deal  of  detail,  but  It  actually 
does  not  begin  to  exhaust  the  issues  discussed.  Section  4.2  deals  with  the 
way  word  definitions  are  used  to  build  the  eeaantlc  representation,  and 
section  4.4  discusses  o*1*-;'  contributions  to  the  representation.  The  actual 
inforaatlon  In  the  representation  is  sueaarlzed  in  section  4.3.  Not  all  words 
contribute  to  the  seaantic  representation  directly,  and  this  is  considered  in 
section  4.S.  Section  4.7  discusses  Markers  that  cause  special  actions  in  the 
systea,  while  sections  4.S  and  4.8  handle  the  representation  of  Idloas  and 
coreference,  respectively.  Finally,  section  4.9  discusses  the  representation 
of  theMatic  inforeation,  and  section  4.10  treat!  seeantlc  case. 

4.1.2  The  Representation 

The  seMantic  representation  Is  constructed  froa  three  sorts  of 
coMponentsi  object,  relation,  and  property  eeaantlc  structures  (OSS,  RSS,  and 
PSS,  respectively).  These  coaponente  are  bundles  of  inforaatlon,  and  thslr 
linkage  reflects  interrelationships  within  a sentence.  In  general,  a semantic 
representation  is  a network  rather  than  a tree.  By  differentiating  between 
two  sorte  of  linkage,  however,  we  can  always  find  an  underlying  tree  etructure 
in  a well-foraed  sentence.  A saaple  representation  is  shown  In  Appendix  0, 


79 


and  1 uill  spend  most  of  this  chapter  discussing  why  it  looks  the  way  it  does. 
The  diagrams  that  u i II  appear  below  are  actually  representations  of  the 
eemantic  representation,  since  the  output  of  the  semantic  component  contains 
more  information  than  ie  shown.  In  the  machine  version,  information  is  hung 
on  the  LISP  property  list  of  special  atoms  produced  for  the  occasion. 

A question  should  be  raised  here  as  to  exactly  what  a semantic 
representation  should  represent.  Uhile  I can  not  really  answer  this  until  the 
eemantic  component  has  been  discussed  in  mor»  detail,  let  me  just  distinguish 
two  levels  of  semantic  information  heret  the  propositional  and  thematic 
levele.  Basically  the  propositional  Isvel  is  related  to  what  ie  said,  the 
thematic  level  to  the  way  it  is  said.  The  thematic  level  deals  with  questions 
like  what  information  ie  important  in  a sentence,  what  the  speaker  wiehes  to 
convey,  and  the  assumptions  he  has  about  what  his  listener  knowe.  The 
semantic  representation  ueed  here  ie  a mixture  of  propositional  and  thematic 
information,  and  I will  come  back  to  the  question  of  what  a eemantic 
representation  should  look  like  below. 

4.1.3  Building  the  Semantic  Representation 

The  semantic  component,  like  Gaul,  hat  three  parte:  the  semantic 

specialist  routines  (SI1SPEC),  the  semantic  utility  routines  (STUTIL),  and  the 
dictionary  definitions.  The  actual  building  of  the  representation  is  done  by 
the  SMUTiL  routines,  and  for  much  of  the  semantic  representation  it  is  the 
dictionary  definitions  which  make  the  calls  to  SfUJTIL.  The  dictionary 
definitions,  in  turn,  are  unleashed  by  SfISPEC  after  it  has  set  all  the 
necessary  calling  parameters.  It  is  the  SHSPEC  routines  that  are  actually 
called  by  the  grammar,  and  many  of  th*se  routines  correspond  to  grammatical 
constituents:  there  are  SMCLAUSE,  SflPREPG,  and  ST1ADX.  The  noun  group,  on  the 
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other  hand,  has  a aeries  of  semantic  specialists,  SMNG1  through  SMNG3.  For  a 
simple  noun  group,  SflNGl  is  called  as  soon  as  the  main  noun  has  been  found, 
and  it  evaluates  ang  prenominal  modifiers  starting  ulth  those  closest  to  the 
noun.  Control  then  returns  to  the  syntactic  component  to  parse  ang 
qualifiers,  and  then  SftJG2  links  these  qualifiers  to  the  noun.  SMNG2  is  also 
responsible  for  evaluating  relational  nouns,  which  are  not  touched  until  the 
entire  noun  group  has  been  parsed.  ST1NG3  checks  for  reference  to  other  parte 
of  the  text  if  the  noun  group  Is  definite.  Also  part  of  the  noun  group 
package  is  SMCOflPOUNO,  which  handles  compound  nouns  that  are  not  in  the 
dictionary  but  whose  component  elements  are.  Finally,  ST1PR0N  and  SHPR0N2 
handle  noun  groupe  that  are  pronouns. 

Note  that  there  is  no  separate  semantic  specialist  for  verbe.  All  the 
actions  necessary  for  verbs  are  done  by  the  single  SNCLAUSE  routine.  By  the 
time  SdCLAUSE  is  called,  the  subject,  verb  objects,  and  modifiers  have  all 
been  parsed.  (This  is  true  enough  as  far  as  it  goes,  but  not  completely  true 
- see  section  4.7.1.)  SOCIALISE  binds  the  relation  specified  by  the  verb  to 
its  participants  (subject  + verb  objects),  then  binds  the  modifiers  to  thle 
relation.  This  whole  process  is  rather  elaborate  in  practice,  and  the 
discussion  later  on  will  shed  some  light  on  the  kinds  of  information  SMCLAUSE 
has  to  process. 

Uherever  the  semantic  specialists  are  called  in  the  parse,  their  general 
role  is  to  be  yea-  or  nay-  sayers.  Uhsnever  a semantic  relation,  say  the 
definition  of  a verb,  is  bound,  checks  are  made  using  the  selection 
restrictions  described  in  the  previous  chapter.  If  at  any  time  no 
representation  can  be  built  for  the  section  parsed,  then  semantics  returne 
failure  to  syntax.  In  the  system  as  it  stands  now,  semantics  never  touches 
'.he  paree  tree  except  to  get  information  from  it,  although  the  unimplemented 
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ideae  in  section  2.7.1  would  involve  a rots  active  eeaantics. 

4.2  Lexical  Semantic  Structures 
4.2.1  The  Standard  Definitions 

To  get  a better  idea  of  the  way  a semantic  representation  is  built  up. 
iet  us  take  a bo t ton-up  approach  and  start  with  examples  of  the  three  standard 


definition  types. 


(OEFD  ELEOONE 
SEMANTICS  ( 

(NOUN  (OBJECT  CONCEPTi  0ELEOONE 

CONNOTATIONS:  +SCIENTIFIC 
LABEL!  01)))) 

(OEFO  FOLG 
SEMANTICS  ( 

(VERB  (RELATION 

CONCEPT!  AfGO-BEFORE-I  N-T I ME 
TYPE!  NONE  OROERi  LEXPASS 
ARCS:  2 LABEL!  li  )))) 

(OEFO  BLAU 
SEMANTICS  ( 

(AOJ  (PROPERTY  CONCEPTi  #BLUE 
CONNOTATIONS!  ^COMMON 
LABELi  03)))) 


The  semantic  definitions  here  have  the  following  partei 
The  Selector! 

The  first  entry  in  any  semantic  definition  ie  a uyntactic  feature,  which  need 
not  neceeeariiy  be  the  part  of  speech,  any  distinguishing  feature  will  do. 

The  syntactic  features  that  were  chosen  in  the  course  of  the  parse  can  thus  be 
used  to  eliminate  semantic  poeeibi i ities  by  matching  against  the  first  entry 
in  each  semantic  definition.  For  example,  if  schwimmen  has  been  pareed  as  a 
noun,  there  is  no  need  to  consider  ite  meanings  as  a verb.  If  more  than  a 
single  feature  is  needed  to  discriminate  between  definitions,  then  a list  of 
features  may  be  used.  In  addition,  if  more  than  one  syntactic  feature  list 
takee  a particular  eemantic  definition,  then  a I iet  of  distinguishing  features 
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prefixed  oy  EITHER  May  be  ueed. 

The  Routine  Name: 

OBJECT,  RELATION  , and  PROPERTY  routinee  are  part  of  SfUJTIL.  and  build  OSS, 

RSS  and  PSS  coMponente,  respectively.  The  rest  of  +he  information  in  the 
definition  supplies  parameters  for  these  routines,  indexed  by  the  following 
kcyuordst 

CONCEPT  : 

This  is  the  semantic  marker  ussd  in  building  up  the  semantic  representation. 

It  is  a part  of  the  concept  structure  discussed  in  the  previous  chapter. 

TYPE:  (relations  only) 

This  specifies  the  relation  of  the  surface  arguments  to  the  semantic  ones. 
Types  are  ONE,  TUO,  THREF  rZ..v,  fUOATHREE,  etc.,  and  they  tel!  which  of  the 
semantic  arguments  may  ...t  understood  in  the  surface  representation.  For 
exampla,  we  may  expect  certain  relations  to  have  an  instrument  specified  at 
the  semantic  level.  The  relation  0CUT,  then,  woulu  have  three  arguments: 
actor,  patient  and  instrument.  In  'he  sentence  "Karl  schnitt  das  Uuret  ait 
einem  Messer"  ("Karl  cut  the  sausage  uith  a knife"),  the  definition  used  for 
the  verb  schne i den  would  have  type  NONE,  since  no  arguments  are  left 
understood.  In  "Karl  schnitt  das  Uurst"  ("Karl  cut  the  sausage"),  a 
definition  of  type  THREE  would  be  used,  since  the  third  argument  - the 
instrument  - is  left  understood.  Similarly,  "Ein  Messer  echnitt  das  Uuret" 

("A  knife  cut  the  sausage")  needs  a definition  of  type  ONE,  since  the  actor  ie 
left  understood. 
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ORDER:  (relation#  only) 

Thit  is  another  way  to  eupply  information  fo.  Matching  eurface  arguaente  to 
semantic  ones.  ' 'der  is  used  for  word  pairs  like  Drecads  and  fol  low,  or  in 
German  voraehen  ana  foloen.  Ue  want  these  paii  to  Map  into  a single  eeaantic 
marker,  and  to  do  thie,  one  of  the  pairs  is  labe.led  as  lexically  active 
(LEXACT)  and  the  other  as  lexically  passive  (LEXPASS).  Uhen  order  is  LEXPASS, 
ao  in  the  example  relation  above,  then  what  the  syntax  has  labeled  ae  subject 
(in  an  active  sentence)  becomes  the  second  argument  of  the  semantic  relation. 
The  decision  about  uhich  word  is  the  lexically  active  one  and  uhlch  the 
passive  one  'e  arbitrary. 

ARGS:  (relations  only) 

This  is  redundant  information,  since  ue  can  aluays  recover  the  nuaber  of 
arguments  a relation  takes  given  its  naae  (by  checking  the  'eng.h  of  ite 
associated  restrictions  list).  ARCS  is  specified  in  tho  definition  anyuay, 
however,  partly  for  efficiency  reasons,  and  partly  to  help  ae  keep  track  of 
things  uhen  writing  the  dictionary  definitions. 

CONNOTATION?: 

This  holds  the  connotation  information  mentioned  in  section  3.7,  uhich  hi 
expected  to  be  in  binary  fora  (♦slang,  ♦scientific,  -technical,  etc.).  Right 
now,  thii  information  is  optional,  and  it  is  not  used  by  the  system  until 
generation. 

LABEL: 

If  a word  hae  more  than  one  semantic  definition,  each  is  givsn  a labs!.  These 
are  used  fc  error  messages  and  cross-referencing  with  other  Information. 
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The  system  has  a group  of  functions  that  pick  information  out  of  semantic 
definitions.  . These  are  used  in  SflSPEC  to  make  sure  that  the  right  global 
variables  are  set  in  varirus  cases.  Uhat  th.s  set  of  definition  searchers 
amounts  to  is  the  ability  to  use  definitions  descriptively  as  well  as 
imoerati vely.  This  statement  actually  needs  some  qualification,  since  some 
information  in  the  definition,  like  Type  and  Order,  is  really  meant  for  uee  by 
the  SflSPEC  routines,  rather  the i as  actual  semantic  information.  The 
definition  searchers  are  not  used  solely  on  this  Type  and  Order  information, 
however,  so  that  it  is  fair  to  say  that  the  system  treats  definitions  beth 
descriptively  and  procedural ly. 

Another  sort  of  information  that  should  be  in  the  definitions,  but  is  not 
now,  is  a measure  of  plausibility.  This  cou'.d  take  the  form  of  a number  that 
specifies  the  probability  that  a semant!c  sense  is  used,  gi'—«  that  the  word 
occurs.  Such  probability  measures  appear  in  Uinograd’s  system,  but  were  not 
used  here  because  of  time  limitations. 

4.2.2  Other  Definition  Types 

In  addition  to  the  three  standard  definition  types,  there  are  several 
other  dictionary  functions:  SPECIAL,  ShNOflJNALIZE,  and  SMREL-PART.  A SPECIAL 
definition  type  is  used  for  relations  tha*  do  not  fit  existinn  definition 
types.  A SPECIAL  definition  just  has  a small  rcutine  associated  with  it. 

This  eort  of  freedom  is  really  valuable  for  exceptional  cases  like  aein  ("to 
be"),  but  it  has  been  used  sparingly  elsewhere  in  the  system.  Often,  a 
definition  will  start  out  as  b^HAL,  but  then  another  word  like  it  will  come 
along,  and  eventually  we  have  a class,  warranting  its  own  function  type. 

ShNOHINALIZE  is  a definition  type  designed  to  handle  rankshift.  Just  as 
we  have  clauses  serving  as  rankshifted  noun  groups  (*Ich  weiss  nicht,  warum  er 
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hier  ist."  / "1  don’t  know  uhy  he  it  here."),  there  are  aieo  relatione  that 
may  be  represented  by  nouns  ("Das  Stehen  f8iit  ihm  schwer."  / "He  has  trouble 
etandina. ")  In  both  Genian  and  English,  any  verb  infinitive  may  be  a 
rankehifted  noun,  and  there  are  also  words  like  "der  Auf stand"  ("the 
uprieing")  whose  semantic  definitions  are  basically  relations  rather  than 
objects.  In  the  semantic  representation  we  want  these  to  appear  ae  relational 
but,  since  the  syntax  is  a noun  group,  special  actions  have  to  be  taken  (for 
example,  to  handle  time).  SflNOfllNALlZE,  then.  Is  responsible  for  some  of  this 
action  directly  and  also  acts  as  a signal  to  other  noun-handling  routinee  that 
special  treatment  is  in  order. 

SDREL-PART  handles  nouns  that  name  a participant  in  a relation.  For 
example,  the  word  Zeichen  ("indication")  can  be  defined  as  "something  that  is 
acting  as  the  first  argument  for  the  relation  VINDICATE. * The  SflREL-PART  for 
Zeichen.  then,  builds  up  a piece  of  representation  that  may  itself  be 
represented  by  Fig.  4.1. 


Figure  4.1 

The  ISOHETHtNG  and  OUNSPEC  here  ere  marked  HETA  because  they  are  meta- 
concepts, or  concept  variables.  The  WJNSPEC  marker  (for  "unspecified"  - see 
section  4.7.2  below)  would  probably  not  jb  used  here,  since  the  information 
would  be  given  scmewhere  in  the  noun  group,  as  it  is  in  our  c.mple  text  ("Ein 
deutlich  sichtbares  Zeichen  lie.  CLift  •••  Errepunaen"  / "A  clearly  visible 
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Indication  at  the  mxci tat  ions*)  Both  the  SHREL-PART  and  the  SMNOfllNALlZE 
routines  are  attractive  because  they  offer  econoeyi  ue  do  not  need  a eeparate 
concept  Marker  for  a relation  or  relation  participant  treated  as  an  object. 

4.3  Information  in  tha  Seaantic  Structure* 

Uhen  the  definition  types  above  art  executed,  ue  get  semantic  components 
that  contain  the  fallowing  information! 

0SSN00E-.  PSSN00E-,  or  RSSNOOE- 

This  is  the  name  generated  for  the  semantic  node;  no  tuo  node  namee  are  alike. 
VARIABLE- 

A variable  is  aesigned  to  an  individual  instantiation  of  an  object,  relation, 
or  property.  The  node  namee  above  may  change  in  the  course  of  bui  iding  a 
representation  for  a particular  syntactic  structurs,  but  the  variable  remains 
the  same. 

CONCEPT- 

This  comes  from  the  calling  parameters,  and  It  Is  our  old  friend  the  seaantic 
marker. 

RESTRICTIONS-  (PSS  tnd  RSS  only? 

Selection  restrictions  are  hung  from  the  conceptual  structure,  being 
associated  with  a particular  relation,  property  or  subtree  thereof.  Once  the 
semantic  utility  programs  have  retrieved  a set  of  restrictions,  they  are  kept 
on  the  semantic  node  for  I at  - *-eference. 
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LINKAGE-  (RSS  only) 

This  is  a list  of  the  participants  in  a relation,  and  it  repreeenta  half  of 
the  explicit  linkage  that  holds  the  seeantic  representation  together. 

M00IF1ERS- 

Another  mechanism  for  linking,  this  thsaatic  feature  binds  OSS,  RSS  and  PSS 
components  to  their  modifying  relations.  Uhile  LINKAGE  values  produce  a tree 
structure,  uhen  values  from  MODIFIERS  are  added  in  ue  can  get  a general 
netuork  structure.  A semantic  node  with  modifying  relations  is  called  the 
"head"  of  these  relations. 

CASE- 

CASE  is  set  to  a concept  marker  that  is  found  above  the  CONCEPT  on  the 
selection  restriction  tree  and  distinguished  by  a special  tag.  Thie  ie 
redundant  information,  since  the  case  is  always  derivable  from  the  concept 
marker.  It  is  ussful  information  to  have  around,  however,  especially  for  the 
deductive  component.  CASE  is  set  only  for  PSS's  and  RSS’e  that  act  ae 
modifiers,  that  is,  those  which  are  connected  to  the  semantic  representation 
by  nOOIFlERS  linkage.  Sample  cases  ars  SPATIAL,  TEMPORAL,  and  MANNER.  The 
use  of  the  term  "case"  for  this  semantic  feature  may  be  misleading,  and  it  is 
discussed  in  more  detail  in  section  A. 10. 

TYPE-  (RSS  only) 

This  is  the  TYPE  information  supplied  by  the  dictionary  routines.  It  ie  not 
really  semantic  level  information,  but  it  is  put  into  the  representation 
anyway  for  efficiency  reasons. 
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ORDER-  (RSS  only) 

See  TYPE. 

REFERENCE-SCOPE- 

This  is  set  to  either  GENERIC  or  PARTICULAR,  depending  on  whether  the 
information  given  is  about  a particular  object,  relation  or  property,  or  about 
the  class  thereof. 

GIVEN-NEU- 

This  is  set  to  GIVEN  or  NEW.  See  section  A. 9. 2 for  an  explanation. 

COREF- 

This  gives  a list  of  semantic  structures  that  are  coreferent  with  this  one. 

It  is  discussed  further  in  section  A. 8. 

I NFO-ORDER- 

Thie  is  set  to  either  UNMARKED  or  to  a list  of  the  modifying  relatione  In  a 
clause  in  the  order  that  they  appeared  in  the  surface  structure.  It  ie 
discussed  further  in  section  A. 9. 3. 

CONNOTATIONS- 

This  is  the  connotation  information  from  the  dictionary  definition. 

THEME - 

This  is  set  to  the  semantic  node  that  corresponds  to  the  theme  of  the  clause. 
See  section  A. 9. 3 for  an  explanation. 
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RESTRICT-DESCRIBE- 

This  is  set  to  either  RESTRICT  or  DESCRIBE.  See  section  4.9.3  for  further 
discussion. 

CLAUSE-TYPE- 

This  is  set  to  C0TV1AND.  QUESTION.  STATETENT.  or  SUBORDINATE.  See  section 
4.9.3  for  an  explanation. 

PARSENOOE- 

This  is  set  to  the  parse-node  that  supplied  the  concept,  if  there  is  one. 
PARALLEIS- 

This  is  used  in  representing  a variety  of  coreference.  See  section  4.8  for 
detai Is. 


4.4  Non-Lexical  Entries  in  the  Semantic  Representation 
The  uord  definitions  discussed  above  fore  an  important  part  of  the 
semantic  representation.  Not  all  entries  in  the  representation,  houever,  a.  e 
formed  by  uords  - some  entries  represent  relations  implicit  in  the  syntax  of 
the  sentence.  Some  examples  of  this  Mill  be  discussed  here  - e.g.  the 
postnominal  genitive,  adjectives  «..<at  modify  nouns,  and  compound  nouns.  Those 
are  closely-related  cases  and  by  no  means  exhaustive,  but  they  give  a 
representative  indication  of  the  issues  involved.  Uhersver  there  is  an 
implicit  relation,  it  is  the  ST1SPEC  routines  that  supply  it  and  make  the  call 
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4.4.1  The  Genitive 

Starting  off  uith  an  exaeple,  the  semantic  representation  for  the 
genitive  construction  "der  Regenschlre  der  Daee”  ("the  lady’e  umbrella,” 
literally,  "the  uebrella  of  the  lady")  eight  look  like  Figure  4.2. 


Figure  4.2 

For  "dae  Auge  dee  Hueeere"  ("the  eye  of  the  lobeter")  ue  eight  have  Figure 
4.3. 


Figure  4.3 

In  the  diagraas,  "head"  is  used  to  indicate  that  the  linking  of  the  tuo  OSS’s 
ie  done  using  the  register  HOOIFIERS,  rather  than  the  LINKAGE  register.  In 
the  tuo  exaepleo,  the  OSS’s  are  foreed  In  response  to  the  nouns  in  the 
phrases,  but  the  RSS  reflects  an  1 np licit  relation.  (Actions  taken  for  the 
detereiners  have  been  left  out  of  this  initial  paes  for  the  sake  of 

simplicity.)  The  tuo  phraser  give  no  explicit  clues  to  guide  the  choice 

betueen  0OUN  and  0HAVE-AS-PART  as  interpretations.  Uhat’s  more,  there  are  a 
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number  of  other  possible  relations  that  may  be  implied  by  the  genitive,  e.g.t 

der  Geruch  des  KSses  ■ the  smell  of  the  cheese 
aspect  of  a thing  + thing 

das  Buch  des  berQhmten  Poeten  - the  famous  poet’e  book 
creation  + creator 

der  Stadt  meiner  Geburt  - the  city  of  my  birth 
aspect  of  a relation  + relational  noun 

das  Geschichte  meines  Lebens  - the  story  of  my  life 
account  + subject  matter 

There  are  many  such  relations  that  can  be  expressed  using  the  genitive,  but 
the  possibilities  here  are  not  completely  open.  For  example, 
das  Pflanze  meines  ^chreibtischs  / the  plant  of  my  desk 
cannot  be  construed  to  mean  the  plant  that  is  on  my  desk.  To  say  this,  both 
German  and  English  use  a preposition  (auf  / on)  to  explicitly  express  the 
spatial  relationship.  Thus,  if  the  number  of  relations  that  are  implicit  in 
the  genitive  is  bounded,  as  1 believe  to  be  the  case,  it  makes  sense  to  talk 
about  producing  semantic  representations  for  the  different  poesibi I i t iee.  Some 
of  the  possibilities  are  in  fact  constructed  by  the  system,  using  selection 
restrictions  as  a filter  to  block  the  blatantly  impossible  combinations.  The 
next  step  is  to  take  a closer  look  at  these  semantic  representations  using  the 
deductive  component;  but  let  us  first  finish  up  the  discussion  of  hou  to  build 
semantic  representations  before  going  into  the  question  of  hou  to  chooee 
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between  them, 

4.4.2  Noun  flodlf  Ication 

Another  eKaaple  of  a semantic  relation  that  ia  implied  by  a grammatical 
structure  is  WAVE -PROPERTY.  Any  property  used  to  eodlfy  an  object  (or  a 
relation  or  another  property,  for  that  eatter)  is  given  a WAVE-PROPERTY 
relation.  Thus,  "dsr  kurzsichtige  Uissenschaf tier"  ("the  nearsighted 
scientist")  would  be  represented  by  Figure  4.4.  The  WAVE-PROPERTY  relation 
is  special,  in  that  the  selection  restriction  for  its  first  argueent  is  found 
associated  with  Its  second.  In  the  example,  the  restriction  #LIVING-THING  ie 
associated  with  WEARSIGHTEO,  so  our  scientist  would  pass  the  test.  Instead 
of  conventional  selectional  restrictions,  therefore,  WAVE-PROPERTY  lias  a 
procedure,  which  is  automatical  ly  executed  by  the  restriction  checking 
procedure.  The  restriction  code  for  WAVE-PROPERTY  retrieves  the  selection 
restriction  froe  its  second  argueent  and  usss  It  to  perform  the  check  on  its 
first. 


Figure  4.4 

One  issue  in  noun  modifier  representation  should  be  mentioned  here.  In 


German,  as  in  English,  adjectives  may  bs  stacked  up  in  front  of  nouns  In  two 
uaysi  serially  or  in  parallel.  The  parallel  version  is  the  one  that  often  hae 
a comma  "die  kleine,  lebhafte  Eledone"  ("the  small,  active  eledone").  The 
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Modifying  relatione  for  soaething  I ke  "der  nette  site  Mann*  ("the  nice  old 
Man")  could  be  represented  byt 
der  (nette  (alte  Mann)) 

That  is.  each  adjective  Modifies  the  entire  remainder  of  the  phraei.  The 
correct  repreeentation,  therefore,  uoulc*  eeeM  to  be  that  ehoun  in  Figure  4.6. 
Thie  sort  of  representation  is  accurate,  but  I think  the  proliferation  of 
OSS'e  uould  cause  a great  deal  of  extra  effort  for  the  generator.  Another 
sort  of  linkage  uould  be  neceetary  to  relate  the  different  OSS’e  of  a noun 
group,  and  representations  uould  be  larger.  To  avoid  this,  the  syeteM 
abbreviates  the  representation  of  Figure  4.6  slightly,  using  tha  Modifier 
relation  eetabiished  betueen  adjective  and  noun  instead  of  a neu  OSS.  The 
result  ie  ehoun  in  Figure  4.7. 


Figure  4.7 

Thie  repreeentation  might  break  doun  if  modifying  relatione  themeelvee  have  a 
lot  of  modification,  but  thie  uould  only  be  happening  for  pronominal  claueee, 
not  #HAVE -PROPERTY  relatione,  and  clauses  uill  probably  not  be  etacked  up 
eerially  More  than  tuo-deep. 
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1 should  note  that  only  the  simplest  sort  of  adjectives  are  current iy 
handled  by  the  semantic  component.  For  an  analyeie  of  some  of  the 
complexities  involved  in  Engl ish  adjectives,  see  Vend  I er  (35). 

4.4.3  Compound  Nouns 

The  German  compound  noun  is  often  translated  by  a classifier  plus  noun  In 
English  (for  example,  "die  Feuerwahr"  / "the  fire  department").  Among  the 
relations  that  occur  betueen  the  parte  of  German  compounds  are  relatione 
discussed  for  the  genitive  and  simple  noun  mndiflare,  so  the  representation 
described  in  the  last  two  sections  is  also  applicable  here.  Uith  compounde, 
we  also  yet  relations  that  could  be  expressed  using  prepositions,  such  ast 
die  Gummistiefel  - Stiefsl  aue  Gummi 
rubber  boots  (material  of) 
die  TrinkglSser  - GISoer  zum  Trinken 

drinking  glasses  (use  or  function  of) 
die  Todesanzeige  - eine  Anzeige  wegen  des  Todes 
death  notice,  obituary  (occasion  of) 
die  Seereise  - eine  Reise  auf  der  See 
sea  voyage  (place  of) 

Especially  uith  the  mors  common  implicit  relations,  ue  uould  like  to  be 
able  to  handle  compounds  that  are  not  in  the  dictionary  but  uhose  parts  are. 
The  system  does  this  in  the  routine  SnCOdPOUND.  In  a procedure  analogoue  to 
that  for  genitives,  the  semantics  of  the  component  uords  are  bound  to  a group 
of  possible  relations,  selection  restrictions  permitting,  of  course.  The 
representation  produced  looks  either  like  the  output  of  the  genitive  routine 
or  like  representations  of  other  noun  modifiers.  This  approach  is  deeirable 
because  the  representation  resembles  those  built  for  eimilar  etructures,  the 
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dictionary  is  not  loaded  wi  th  redundant  definitions,  jnd  the  system  is  able  to 
cope  with  new  compounds  it  has  not  seen  before. 

The  drawback  of  using  the  semantic  component  to  supply  implicit  relatione 
from  a built-in  set  is  that  the  range  of  relations  possible  between  the 
compound's  components  is  much  wider  than  the  range  of  relations  for  either 
genitives  or  simple  noun  modifiers.  1 suspect  that  it  is  an  open  set,  and 
this  would  mean  that  certain  word  pairs  could  have  implicit  relations  that  are 
completely  idiosyncratic,  if  a relation  appears  only  in  one  compound,  it 
obviously  does  not  belong  in  SflCOflPOUNO.  This  seems  to  be  the  place  for  a 
dictionary  definition,  and  in  fact  the  SPECIAL  definition  facility  in  the 
system  could  handle  the  situation  uith  no  trouble.  A RSS  for  the  implicit 
relation  could  be  built  in  the  definition,  binding  the  compound’s  components 
as  participants.  This  is  clearly  an  efficient  approach,  as  long  as  the  eyetem 
has  a definition  for  each  idiosyncratic  compound  it  encounters. 

Between  the  compounds  formed  from  a predictable  set  and  the  completely 
idiosyncratic  compounds  are  a group  that  show  some  regularity,  although  the 
particular  relations  involved  are  unpredictable.  These  are  given 
representations  by  the  semantic  component,  but  an  flUNSPEC  (for  "unspecified") 
marker  is  used.  The  marker  is  discussed  below  in  section  4.7.2,  and  the 
compound  class  is  investigated  in  more  detail  in  section  5.S. 

Finally,  there  are  compounds  for  which  the  meaning  of  the  whole  is 
different  from  the  sum  of  the  meanings  of  its  parts.  Consider  "der 
Tintenfiech"  ("the  cuttlefish"  or  "squid;"  literally,  "ink  fish").  Leaving 
aside  the  point  that  the  squid  is  "iot  a fish  to  a biologist,  we  note  that  "dor 
Tintenf  isch"  refers  not  just  to  any  water  animal  that  spews  an  inky  cloud,  but 
to  the  cuttlefish.  If  there  is  some  other  fish-like  creature  that  also  spews 
ink,  it  would  not  be  designated  by  Tintenf i9ch.  Such  a si ti.'.ti on  seems  to 
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warrant  a separate  concept  like  0SQUID,  and  so  the  representation  for  thle 
typa  of  compound  looks  no  different  *rom  that  of  a regular  noun. 

For  representing  compounds,  then,  the  system  offers  four  alternatives! 
pre-packagsd  implicit  relations,  special  dictionary  definitions, 
representations  that  leave  the  relation  unspecified  for  the  time  being,  and 
standard  object  definitions  for  compounds  whose  meanings  are  more  than  the  eum 
of  the  meanings  of  th*ir  parts. 

This  last  group  of  compounds  mentioned  raises  a question.  Do  not  all 
compounds,  in  fact,  tend  to  be  more  than  the  sum  of  their  parts?  Uhen  faced 
with  "Gummistiefel"  ("rubber  boots"),  ws  know  something  about  this  special 
type  of  footwear,  just  as  we  have  specific  information  about  '’SchnOrst iefel " 
(literally  "lacing  boots"  - any  boot  that  has  a shoelace)  and  "Holzschuhe” 
("clogs").  Ue  would  want  to  associate  this  information  with  a specific 
concept  marker,  rather  than  the  more  general  concept  0FOOTUEAR.  Given  the 
system  we  have  now,  If  the  representation  for  "Gummietiefel"  wae  supplied  by 
SMCOflPOUNO,  there  is  nowhere  to  put  the  information.  This  is  a problem,  but 
it  is  one  that  the  system  does  not  have  to  face,  since  it  is  not  intended  to 
do  any  learning  (i.e.  it  is  assumed  that  the  information  in  a sentence  would 
never  be  used  to  permanently  change  the  deductive  data  base). 

If  ue  wanted  to  allow  learning  in  the  system,  ue  might  try  the  following 
approach.  Uhen  a new  compound  is  encountered,  the  implicit  relation  could  be 
selected  by  SflCOflPOUNO,  but  then  instead  of  adding  this  to  the  semantic 
representation,  ue  could  create  a new  concept  marker.  For  example,  a new 
"Gummi8t iefel " concept  would  have  0FUOTUEAR  as  gsnus  and  something  like 
( ABATER  I AL -OF  X #RL®BER)  as  differentia.  Then  any  new  information  learned 
about  rubber  boots,  e.g.  that  they  are  worn  in  the  rein,  could  be  aseociated 
with  the  new  concept,  in  addition,  we  could  add  a dictionary  definition  for 
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Guirnni  st  iefel . so  that  the  next  use  of  the  word  would  invoke  the  new  concept. 

It  would  only  be  economical  to  build  new  r.oncepte,  of  course,  if  they  are 
really  ueeful  for  otganizing  information  in  the  deductive  data  baee.  There 
would  therefore  have  to  be  some  criterion  for  how  much  epecial  information  ie 
needed  to  justify  the  creation  of  a separate  concept  marker.  The  creation  of 
new  concept  markers  would  aleo  affect  generation,  so  we  would  need  a facility 
to  update  dictionary  definitions  for  the  generator  accordingly. 

Since,  however,  we  are  not  trying  to  deserve  a framework  for  learning, 
there  is  no  need  to  generate  new  concept  markers.  The  compromiee  used  in  the 
system  was  to  give  concept  markers  to  compounds  that  had  a good  deal  of 
information  associated  with  them  per  ee  - like  "dae  Nervensyetem"  / "the 
nervoue  system".  Uords  for  which  the  bulk  of  special  information  uouid 
probably  be  encountered  in  the  input  text  for  the  first  time  - like  “dae 
Chroma t jnorenspiel"  / "play  of  the  chroma tophores"  - are  represented  by 
chunke  of  semantic  representation  {relation  + participants).  Theee  are 
constructed  by  SMCOflPOUND,  as  deecribed  abovs,  unless  an  idloeyncrat ic 
relation  ie  involved. 

*** 

It  ie  thue  necessary  to  eupply  implicit  relations  for  genitivee, 
adjectives,  and  compounds  in  the  noun  group  in  order  to  develop 
repreeentat ione  for  tks  different  possibilities.  In  general,  only  the 
deductive  component  can  decide  between  the  set  of  different  representations 
produced. 


4.5  Uords  Uithout  Semantic  Representations 
In  the  last  eection  we  looked  at  relatione  that  were  not  tied  to 
epecific  worde,  but  now  the  question  is  whether  an  entry  in  the  semantic 
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representation  must  be  formed  for  all  uords.  In  fact,  not  all  uords  add  to 
the  representation;  generally,  uords  that  do  not  are  lou  in  semantic  content 
and  very  high  in  syntactic  function.  The  most  common  case  of  this  is 
prepositions  that  mark  participants  in  relations.  For  example, 

Die  Eledone  roagierte  flyi  den  Reiz. 

The  eledone  reacted  i£  the  stimulus. 

Such  prepositions  occur  both  uith  verbs  and  adjectives,  but  only  the  former 
uill  be  discussed  here.  Obviously  not  all  prepositions  are  of  this  type; 
those  that  mark  location,  time,  causality,  etc.  are  high  in  individual 
semantic  content  and  not  dependent,  except  in  the  moet  general  uay,  on  the 
particular  verb  used.  The  prepositions  i am  considering  are  those  closely 
tiod  to  individual  verbs  and  uhose  functions  are  performed  by  case  in  other 
situations:  "mir  gefflllt  ea"  versus  "ich  freue  mich  darQber"  in  German 

(roughly,  "I  I ike  j_i*  and  "I  am  happy  about  ii"),  look  a±  versus  observe  in 
English.  Where  such  prepositions  occur,  their  semantics  is  essentially  a no- 
op,  i.e.  the  semantics  of  the  prepositional  object  is  stuck  into  a register 
marked  by  the  preposition  name.  When  the  relation  associated  uith  the  verb  is 
evaluated  in  SMCLAUSE,  a list  of  its  required  prepositions  is  retrieved  from 
the  collocations  list.  These  prepositions  are  indexed  by  semantic  definition 
labels,  since  a difference  in  preposition  can  indicate  a difference  in 
sema.  tics  (rdient  als"  / "serves  as"  versus  "dient  zu"  / "serves  to").  For 
each  definition,  then,  ue  knou  exactly  uhere  to  look  for  the  semantics  of  i te 
participants.  In  the  case  of  a required  preposition,  ue  just  pick  up  the 
object's  semantics  from  the  register  that  uas  set.  Note  that  essentiaily  the 
same  procedure  is  folloued  for  separable  prefixes,  since  a separable  prefix 
erb  is  considered  to  be  one  uord.  This  uniformity  is  desirable  <n  light  of 
the  close  relation  'tueen  prepositions  and  separable  prefixes. 
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It  is  not,  perhaps,  entirely  fair  to  ciaim  that  prepositions  that  mark 
objects  of  the  verb  are  devoid  of  semantic  content.  In  fact,  I was  surprised 
at  the  regularities  tha\  I encountered  in  the  course  of  organizing  the 
selection  restriction  tree.  Fillmore's  case  theory  (5),  of  course,  ie  partly 
based  on  this  sort  of  regularity.  As  an  example,  the  object  of  a mental 
process  (including  in  this  perception)  is  often  marked  by  an 

(a)  Ich  denke  oft  daran- 
I think  at  i t often. 

(b)  Ich  errinere  mich  darap. 

I remember  it. 

(c)  Das  ist  an  Sepia  zu  beobachten. 

That  can  be  observed  in  Sepia. 

In  a sense,  these  regularities  are  not  surprising,  since  people  have  to 
remember  which  prepositions  go  with  which  verbs,  and  the  more  regularities, 
the  hotter.  On  the  other  hand,  the  situation  is  complicated  by  the  fact  that 
the  same  preposition  may  be  used  with  a rather  wide  variety  of  verbs  in  a 
number  of  different  ways.  Thus  we  have  for  auf i 

(d)  Er  wirkt  auf  das  Publikum. 

He  had  an  effect  qq  the  public. 

(e)  Er  reagiert  nicht  darauf . 

He  did  not  react  ifl  it. 

(f)  Uir  haben  stundenlang  auf  ihn  gewartet. 

Ue  waited  for  him  for  hours. 

The  semantics  of  these  required  prepositions,  then,  can  give  a clue  to  the 
relation  between  subject  and  verb  object,  but  the  knowledge  Is  never 
definitive  without  the  evidence  provided  by  the  verb. 
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4.6  Idiomatic  and  Special  Usages 

Another  situation  in  uhich  the  uorde  in  a clause  might  not  map  one-to-one 
onto  the  semantic  representation  is  uhen  idioms  are  present.  I am  using 
" idiom"  here  in  the  semantic  sense,  to  mean  any  phrase  uhose  meaning  is 
different  from  the  sum  of  the  meanings  of  its  component  uords.  A semantic 
representation  for  an  idiom,  then,  is  properly  associated  uith  tha  phraee 
itself.  In  the  system,  the  most  general  uay  to  handle  an  idiom  is  uith  a 
SPECIAL  definition.  For  something  like: 

□as  Eisen  schmieden  solange  es  heiss  ist. 

Strike  uhile  the  iron  is  hot. 

ue  could  urite  a SPECIAL  definition  for  schmieden  ("strike")  that  Mould  check 
for  the  presence  of  the  rest  of  the  phrase,  then  provide  a neu  semantic 
representation  to  embody  a meaning  like  "Act  uhile  there  is  an  opportunity." 
Note  that  the  system  does  not  deal  uith  such  extensive  idioms  right  nou, 
because  none  are  present  in  the  sample  paragraph. 

The  system  does  handle  more  restricted  idiomatic  usages  in  tuo  uaye: 
through  the  collocations  list  and  through  the  selector  mechanism.  The 
selector  uas  mentioned  above  in  section  4,2.1.  Its  purpose  is  to  cross- 
reference  semantic  definitions  uith  syntactic  features.  A facility  not 
mentioned  above  is  the  appearance  of  a uord,  as  uell  as  a feature,  as 
selector.  In  such  a case,  the  semantic  definition  is  applicable  only  if  the 
next  uord  in  the  sentence  matches  this  uord. 

The  uord  selector  facility  is  obviously  limited,  and  it  uould  not  be 
included  in  the  system  if  it  did  not  come  essentially  "for  free."  The 
collocations  list  is  potentially  of  greater  generality,  although  right  nou  It 
is  used  only  for  associating  prepositions  uith  verbs,  as  described  in  the  laet 
section.  In  the  collocations  list,  ue  can  index  the  meaning  of  a verb  by  a 


162 


preposition  or  separable  prefix  elsewhere  in  the  sentence.  It  would  not  be 
difficult  to  extend  this  Mechanise  to  handle  IdloMs  like  our  "Strike  while  the 
Iron  Is  hot*  exaeple,  and  I suspect  that  this  would  be  a good  wag  to  proceed. 
Ur i ting  a SPECIAL  definition  for  every  idloM  that  we  want  to  add  to  the  syeteM 
would  be  tiae  consueing,  and  the  code  would  be  repetitious.  The  best  policy 
eeeMe  to  be  to  use  SPECIAL  definitions  sparingly,  and  to  use  the  collocation 
siechanisM  to  reflect  the  regularities  that  can  be  found. 

4.7  Special  Entries  in  the  SeMantic  Representation 

Several  special  concept  Markers  are  used  In  the  semantic  representation 
ae  it  is  built  up.  These  are  the  concept  variables  ISOHETHING,  MJNSPEC, 
^UNBOUND,  and  0REFERENT.  The  first,  #S0t€THING,  helps  represent  nouns  that 
naae  a participant  in  a relation,  and  its  use  was  illustrated  In  section 
4.2.2.  The  three  other  netaconcepts,  which  will  all  have  been  replaced  by  the 
time  that  the  generator  gets  the  seMantic  representation,  are  the  subject  of 
this  section. 

4.7.1  The  /^UNBOUND  Flag 

The  #Uf©0UN0  Marker  is  a tsMporary  placeholder  which  disappears  by  the 
tlMe  the  seMantic  component  finishes  its  work.  The  purpose  of  thie  marker  Is 
to  al lou  evaluation  of  relations  before  all  their  participants  have  been 
bound.  This  is  not  in  any  way  a theoretical  necessity,  since  we  can  aluays 
wait  until  all  the  participants  are  In  before  evaluating  a relation.  I find 
it  a satisfactory  solution,  howevsr,  bscause  it  keeps  the  seMantic  component 
fairly  modular;  that  is,  the  0UNBOUND  mechanise  allows  as  Much  processing  as 
poesible  to  happen  as  soon  as  a phrass  has  been  parsed. 

As  an  exaeple,  consider  the  phrase  "die  Im  Nervensystem  verlaufenden 
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Errogungen"  ("the  excitations  that  run  through  the  nervous  system"; 
literally,  "the  through  the  nervous  system  running  excitations").  Since  ue 
want  to  handle  the  prenomlnal  clause  "im  Nervensystem  ver laufenden"  ae  eoon  ae 
it  is  parsed,  SP.CLAUSE  produces  the  representation  in  Figura  4.8  (and  maybe 
others,  of  course,  for  the  alternative  interpretations).  Note  that  the 
prepositional  phrase  "im  Nervensystem"  was  also  handled  using  0UNBOUNO,  but 
the  processing  for  the  prenominal  clause  has  already  done  the  binding  thera. 
The  representation  shown  is  left  at  the  clausa  node,  where  it  sits  until  the 
main  noun  Erreaunaen  is  parsed  and  SMNG1  is  activated.  SMNG1  calle  the 
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SriHOOIFIERS  routine,  which  is,  as  its  name  implies,  a general  clearing  houee 
for  modifiers  of  nouns,  verbs,  adjectives,  and  the  rest.  SPIM001FIERS  takes 
note  of  ths  fact  that  the  modifier  is  a prenominal  clause,  so  it  knowe  that  an 
^UNBOUND  needs  to  be  replaced  by  ths  OSS  for  the  noun.  Seeing  thie,  it  calle 
REBIND  to  make  a selection  restrictions  check,  do  the  binding,  and  supervise 
any  renaming  that  is  nscessary  to  keep  the  semantic  representation  coneietent. 

Besides  prenominal  clauses,  the  AUNBOIM)  mechanism  is  used  for 
preposition  groups  (since  prepositions  are  generally  represented  by  two-place 
relations),  for  subordinate  clauses  of  various  sorts,  and  for  those  adjective 
groups  that  are  represented  as  relations.  Although  in  some  cases  ell 
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constituents  for  participants  of  the  rotation  will  have  been  parsed,  usually 
not  all  wiill  have  been  evaluated  semantically  (for  example,  the  main  verb). 
Therefore,  the  use  of  ths  (/UNBOUND  mechanism  Is  justified  in  most  casee,  and 
to  Keep  things  uniform,  I have  used  It  throughout.  This  sort  of  feature  Is 
prooabiy  also  useful  in  interpreting  English  (assuming  that  several  other  high 
level  decisions  are  also  kept).  The  special  nature  of  German  syntax 
(prenominal  clauses,  end-order  verbs),  however,  makes  some  sort  of  partial 
binding  mechanism  essential. 

4.7.2  The  MJNSPEC  Marker 

0UNSPEC,  for  "unspecified,"  i*  an  escape  hatch  for  the  semantic 
component;  it  is  a placeholder  for  some  of  the  information  that  ia  ieft 
understood  in  the  utterance.  Some  flUNSPEC  markers  may  be  replaced  when  noun 
group  reference  ie  determined,  but  others  are  left  for  the  deductive  component 
to  mull  over.  An  example  should  give  a better  Idea  of  uhat  ATJNSPEC  ie  used 
for.  One  place  for  this  sort  of  marker  is  in  relational  nouns.  Often  time  is 
left  for  the  reader  to  fill  n.  as  in 

(a)  Karl  err  inerts  oich  an  das  Rennen. 

Karl  remembered  the  race. 

(b)  Karl  freute  sich  auf  das  Rennen. 

Karl  looked  forward  to  the  race. 

In  (a),  the  race  predates  Karl's  mental  action,  in  (b)  Karl’s  mental  process 
comes  first.  Further,  for  many  uses  of  relational  nouns,  some  participant  Is 
left  out,  frequently  the  agent.  In  a lot  of  cases,  the  agent  is  understood  to 
be  the  universal  anyone,  for  example,  "Schilaufen  k8"n  gefdhrlich  oein" 
("Skiing  can  be  dangerous",  i.e.,  anyone  who  Okie  can  find  It  dangerous).  Not 
all  such  constructs  imply  "anyone,"  houever.  Some  agents  can  be  unique,  as  In 
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"der  Erfinder  der  Buchdrucksrkunst"  ("the  inventor  of  printing")*  while  most 
understood  agents  can  only  be  determined  with  respect  to  the  context*  "das 
Abschalten  des  Stroms"  ("*he  cutting  off  of  the  power")  could  be  done  by  o 
homeowner,  a company,  or  a repairman.  The  0UNSPEC  marker  can  be  used,  then, 
to  defer  the  decision  until  more  information  is  availablo.  Another  use  for 
flUNSPEC  is  when  the  grammatical  passive  has  no  agent  ("Der  Strom  uird 
abgeschal  tet"  / "The  power  is  being  cut  off").  He  get  the  same  range  of 
possibilities  here  as  in  the  relational  noun  with  understood  agent. 

4.7.3  tfUNSPEC  for  Ellipsis 

The  #UN5PEC  uses  above  are  basically  determined  by  syntax,  in  some  other 
situations  where  information  is  left  out,  there  seems  to  be  a lexica!  basis 
for  the  deletion.  In  cur  paragraph,  for  example,  there  is  a discussion  of 
whether  octopuses  can  perceive  color.  After  giving  evidence  that  supports  the 
existence  of  color  perception,  the  author  saye,  "...so  scheint  das  zum 
mindesten  ftir  diese  Formen  fQr  e i nen  Farbensinn  zu  aprechen"  ("...this,  then, 
at  least  for  these  species,  seems  to  support  a color  sense") . Here  the  author 
has  substituted  a noun  group  for  a relation  such  as  "the  existence  of"  plus 
the  noun  group.  It  seems  to  ms  that  abbreviations  like  this  depend  very  much 
on  the  special  sense  of  particular  words  (with  possibly  some  grouping  into 
classes  of  words  that  allow  similar  types  of  ellipsis).  In  this  example,  the 
ellipsis  ^ight  be  triggered  by  "sprechen  fOr"  ("support").  For  these  cases, 
then,  it  will  be  up  to  a SPECIAL  definition  routine  to  introduce  the  MJN5PEC 
marker  and  uo  the  necessary  binding.  Deduction  can  then  decide  what  relation 
is  understood.  This  definition  approach  guarantees  that  the  system  can  handle 
special  cases  and  know  what  it  needs  to  bind  for  each  particular  case. 
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4.7.4  The  HfREFERENT  Harker  for  Pronouns 

The  0REFERENT  Marker  is  used  fcr  third  person  pronouns,  since  these  have 
no  concept  markers  to  call  their  own.  This  reflects  the  fact  that  for  the 
semantics  of  a pronoun,  ue  are  total Ig  dependent  on  Information  from  the 
coreferent  noun  group  (or  on  our  knowledge  of  the  actual  referent,  as  for  the 
first  and  sscond  person).  The  0REFERENT  marker  le  supplied  by  pronoun 
definitions,  and  it  is  similar  to  MJN80UN0  in  that  It  has  been  replaced  by  the 
time  the  semantic  representations  reach  the  deductive  component.  The 
mechanism  for  handling  0REFERENT  is  also  functionally  similar  to  that  for 
0UNBOUNr , in  that  the  same  sort  of  rebinding  is  done. 

Lr  us  look  at  the  use  of  the  0REFERENT  marker  in  more  detail.  First, 
for  things  like  personal  and  relative  pronouns,  flREFERENl  might  be  replaced 
almost  immediately.  5MNG1  causes  evaluation  of  the  pronoun  definition, 
sotting  up  the  0REFERENT  marker.  SMNG2  probably  will  not  be  called,  as  ue 
generally  ui  I I not  have  qualifiers  following  these  pronouns.  SfIPRON  is  then 
called  to  handle  reference,  its  job  is  to  construct  a list  of  possible 
referents  (using  heuristics  taken  with  little  change  from  Ulnograd’s  system) 
and  to  eliminate  those  that  do  not  agroe  with  the  pronoun  syntactically  (on 
the  basis  of  gender  and  number).  The  0REFERENT  OSS  is  then  rebound  to  each  of 
these  possible  referents.  As  semantic  processing  continues,  some  of  theee 
ui  1 1 probably  be  eliminated  by  selection  restriction  checks,  and  the  final 
coreference  decisions  will  be  made  by  the  deductive  component. 

From  uhat  has  been  said  so  far,  the  reader  might  conclude  that  the 
flREFERENT  marker  is  not  necessary  in  every  case.  It  is  true  that  if  the 
pronoun  OSS  is  rebound  immediately,  then  the  marker  is  an  extra  step.  Even 
personal  pronouns,  however,  can  make  forward  references,  which  are  enough  to 
justify  the  marker.  Consider  the  examples 
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Ehe  an  immatrikul  ieren  kann,  muss  Johann  die  AufnahmeprQfung  machen. 
Before  b£  can  enroll,  Johann  has  to  take  the  entrance  exam. 

Here,  the  tfREFERENT  marker  is  inserted  for  ac.,  and  it  is  not  rebound  to  the 
OSS  for  Jc.iann  until  SHCLAUSE  is  called  for  the  major  clause.  Another 
situation  where  the  0REFERENT  marker  io  justified  is  the  da-compound,  where 
forward  reference  is  frequent.  In  the  sample  paragraph  we  have: 

...was  ebenfalls  sehr  dafQr  spricht,  dass  diese  Tiere  Farben  zu 
unterscheiden  vermfigen 

...which  again  very  strongly  suggests  that  these  animals  are  able  to 
distinguish  colors 

Here,  dafQr  refers  forward  to  the  "dass"  clause.  For  these  sorts  of  pronouns, 
the  0REFERENT  marker  frequently  remains  as  one  possible  interpretation  untii 
the  end  of  the  sentence,  waiting  for  the  referent  to  be  found. 

Uhen  the  flREFERENT  marker  is  rebound,  we  will  want  some  way  to  represent 
coreference.  Since  coreference  in  full  noun  groups  will  be  represented  like 
pronoun  coreference,  both  are  discussed  together  in  the  next  section. 

A. 8 Representing  Coreference 

It  seems  desirable  for  pronouns  and  definite  noun  groups  (more  properly, 
for  all  noun  groups  that  are  coreferent  with  other  noun  groups  in  the  text)  to 
have  similar  semantic  representations.  By  the  time  the  generator  seee  the 
representation,  there  will  be  no  explicit  indication  of  whether  the  surface 
structure  contained  a pronoun  or  a full  noun  group.  This  makes  'jense,  since 
the  target  language  has  its  own  rules  for  coreferent  noun  groups  and  pronoun 
insertion,  arid  these  may  or  may  not  coincide  with  the  rules  in  the  source 
language.  In  this  section,  I will  discus)  finding  the  coreferent  noun  group, 
the  representation  built,  and  issues  of  pseudo-coreference.  Although  I wi  1 1 
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speak  of  a noun  group  Hreferring“  to  another  noun  group,  I really  wean  that 
the  two  are  coreferent.  Only  extra-1  inpuistic  things  (or  quoted  words  or 
phrases  in  a linguistic  discussion)  are  actually  referred  to  by  noun  groups. 
Note  that  references  can  be  made  to  other  statements  by  using  pronouns  I ike 
das  and  was.  In  the  section  below  I will  concentrate  on  noun  group 
coreference,  but  the  situation  is  much  the  sane  when  a relation  ie  involved. 

For  a pronoun,  we  said  that  the  semantic  component  accumulates  a ‘iet  of 
possible  coreferent  structures.  For  full  noun  groups  the  situation  is 
slightly  different,  and  the  approach  outlined  here  follows  Uinograd.  Pronouns 
are  so  weakly  specified  semantically  that  they  cannot  be  separated  from  their 
referents  by  a great  distance.  Full  noun  groups,  however,  are  much  better 
specified,  and  a referent  could  potentially  be  found  anywhere  in  the  text. 
While  I suspect  that  references  outside  a paragraph  are  limited  to  certain  key 
noun  groups,  I also  think  that  determining  these  noun  groups  is  non-trivial, 
i.e.  not  obvious  from  surface  structure  in  every  case.  So  to  proceed  for  full 
noun  groups  as  we  did  for  pronouns  - constructing  a possibilities  iiet  and 
narrowing  it  - will  not  be  feasible.  Even  if  we  were  to  limit  our  search  for 
referents  to  the  scope  of  a paragraph,  our  possibilities  list  would  not  be 
very  iniiresting,  since  we  have  no  good  way  to  narrow  down  the  possibilities. 
In  some  situations  we  might  be  able  to  use  eelection  restrictions  to  narrow 
possibilities,  but  in  general  they  will  not  be  adequate.  Furthermore, 
coreferent  full  noun  groups  do  not  agree  with  their  referents  in  gender  and 
number.  Wc  would  have  a potent  alh;  bulky  possibilities  list  and  nothing  to 
do  with  it.  For  this  reason,  it  is  left  to  the  deductive  component  to 
determine  which  full  noun  groups  are  coreferent.  Alth'.ug  the  deductive, 
rather  than  the  semantic  component,  will  be  adding  corefer  inre  information  to 
the  semantic  representation  for  full  noun  groups,  I would  like  to  finish  up 
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ths  discussion  of  corsfsrence  at  this  time. 

The  main  feature  of  ths  representation  is  that  coreferent  items  are  given 
thr<  sans  variable  '-agister  setting  VARIABLE-),  although  their  OSS  or  RSS 
n .•  os  differ.  Pronoun  semantic  nodes  will  always  take  their  CONCEPT  setting 
from  the  coreferent  roun  group  when  0REFERENT  is  rst,'*und.  A full  noun  group, 
on  the  other  hand,  always  supplies  its  own  concept  marker.  Given  a variable 
name  alone,  it  is  not  always  easy  to  find  other  semantic  nodes  sharing  the 
same  variable,  so  the  register  COREF  is  set  to  a list  of  all  the  coreferente 
of  this  node.  That  is,  when  we  find  a back  sferenca,  we  set  the  COREF 
register  both  or  ths  referring  semantic  node  and  on  the  nods  refered  to.  This 
will  be  ueeful  for  generation,  sines  a back  reference  in  ons  language  might  be 
better  translated  as  a forward  reference  in  another.  Figure  4.9  shows  some  of 
the  information  that  will  bs  present  in  the  OSS's  of  the  two  corefsrent  noun 
groups:  "the  cephalopod"  and  "this  animal." 


OSSNAME-  0SS1 

OSSNAME-  0SS2 

CONCEPT-  #CEPHAL0P00 

CONCEPT-  tt  ANIMAL 

VARIABLE-  XI 

VARIABLE-  XI 

COREF-  (0SS2) 

COREF-  (0SS1) 

Figure  4.S 


Note  that  other  registers  are  set  separately  for  coreferent  semantic  nodes,  so 
that  they  may,  and  often  will,  differ  in  MOOIFIcRS,  GIVEN-NEU,  etc. 

There  is  another  phenomenon  that  behaves  much  like  conference,  but  which 
we  might  call  pseudo-coreferencs.  'Consider  the  example: 

Anna  bsnOtzts  das  grosss  Uflr*  -buch  und  ich  bsnh'zte  daft  kleine. 

Anna  u d the  big  dictionary  and  I used  Hit  seal  one 


The  noun  group  underlined  in  ins  German  is  elliptic  for  t,  j kleine 
U&rterbuch"  ("ths  small  dictionary"),  and  we  can  supply  the  main  noun  by 
looking  at  a noun  group  earlier  in  the  sentence,  "das  grosse  Ufirterbuch”  ("the 
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big  dictionary").  Ue  Might  think  of  the  second  noun  group  ae  making  a back 
reference  to  "das  grosse  Uf  terbuch,"  except  that  it  refers  to  the  general 
claes  "Udrterbuch"  ("dictionary")  rather  than  to  the  more  restricted  claee 
"large  dictionary."  In  this  case,  ue  are  not  really  dealing  ulth  coreference, 
but  with  an  abbreviated  uay  of  distinguishing  tuo  separate  but  related 
objects.  Ue  represent  the  tuo  uith  different  variables,  but  aleo  note  that 
the  abbreviation  has  been  used  by  filling  in  the  riot  PARALLELS  for  both  noun 
groups.  This  register  is  also  used  to  represent  paral'eliem  exhibited  by 
conjunctions.  (In  our  example  sentence  above,  the  RSS'e  for  the  tuo  conjoined 
clauees  would  also  be  Marked  parallel.)  PARALLELS  ie  also  used  'or  parallel 
main  clauses,  either  connected  by  a semi-colon  or  in  separate  eentencee.  The 
basic  idea  is  that  this  parallelism  information  is  not  really  language 
independent,  since  many  languages  might  have  different  rules  for  conjunct  ione 
or  noun  group  pseudo-coreference.  Houever,  the  use  of  the  PARALLELS  register 
eaves  time  spent  in  making  comparisons  in  the  generator. 

4.3  Semantic  Representation  for  Thematic  Features 
Thematic  systems  represent  the  organization  of  an  utterance  ae  a 
message.  As  such,  they  are  not  restricted  to  the  discourse  level  (i.e. 
linguistic  organization  above  ::he  sentence).  In  fact,  thematic  eyeteme  can  be 
found  at  the  word,  group,  and  clause  levels  of  a systemic  grammar.  The 
distinctions  in  this  section  are  adapted  from  HalUday'e  uork,  hopefully  with 
the  original  intentions  intact.  Readers  wishing  to  judge  for  themselves  are 
referred  to  Halliday  (13,16). 
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4.9.1  Uhat's  in  a Semantic  Representation  - Revisited 

Before  considering  thematic  phenomena  in  detail,  let  us  return  to  the 
question  "Uhat  ehould  a semantic  representation  represent?"  Ue  can  divide  the 
information  in  a semantic  node  (see  section  4.3)  into  three  classes,  one  of 
which  Mill  be  thematic. 

First,  the  eemantic  representation  contains  information  from  the 
propoci  tional  level  - more  or  less.  Strictly  speaking,  I would  consider  the 
propoeltional  level  to  be  raw  knowledge  - semantics  minue  the  thematic 
systems.  But,  ae  ue  will  see  belou,  the  object-relation-property  distinction 
can  be  called  thematic.  To  call  the  propositional  level  semantics  minus 
thematic  Information,  then,  means  that  it  is  an  extremely  low  level  of 
organization.  Let  me  therefore  qualify  the  original  etatement  and  eay  that 
the  eemantic  representation  contains  information  from  the  propositional  levei, 
augmented  by  the  of  ject-relat ion-property  distinction.  In  this  category,  I 
would  place  the  registers  CONCEPT,  CASE,  LINKAGE,  VARIABLE,  and  REFERENCE- 
SCOPE. 

A second  kind  of  Information  in  the  semantic  representation  relates  the 
surface  structure  of  an  utterance  to  this  sem i -propos i t i ona I level.  For  this, 
ue  have  the  registers  TYPE,  ORDER,  RESTRICTIONS,  OSSNOOE.  RSSNOOE,  PSSNOOE, 
and  FARSENODE.  This  is  information  that  is  useful  in  deciding  whether  a 
representation  is  appropriate,  deciding  between  different  semantic 
representations,  and  keeping  track  of  the  way  the  semantic  representation 
corresponds  to  the  syntactic  structure  that  is  being  built  by  the  parser. 

The  reet  of  the  information  in  the  semantic  representation  is  thematic. 
This  includes  CONNOTATIONS.  GIVEN-NEU.  COREF,  PARALLELS,  INF0-0R0ER,  CLAUSE- 
TYPE,  tlOOIFIERS,  THEHE,  and  RESTRICT-OESCRIBE.  The  remainder  of  this  section 
will  be  deyoted  to  these  thematic  categories. 
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4.9.2  Thematic  Organization  Below  the  Clause  Level 

dost  thematic  information  seems  to  be  related  to  the  clause;  the  group 
level  thematic  features  that  uill  be  discussed  here  are  a iso  found  at  the 
clause  level.  One  system  discussed  In  this  section  - information  focus  - ie  a 
discourse  system,  and  should  properly  be  represented  above  the  sentence  level. 
Since,  houever,  its  manifestations  art  assn  at  the  group  and  clause  levels,  it 
uill  be  represented  at  the  relevant  group  and  clause  semantic  nodes. 

A thematic  phenomenon  at  the  uord  level  is  connotation,  related  as  it  Is 
to  the  speaker's  choice  betueen  different  ways  of  expressing  the  same  concept. 

Looking  next  at  the  group  level,  the  head  / modifiers  linkage  seems  to  be 
thematic.  Consider,  for  example,  the  difference  betueen  the  tuo  noun  groupe; 

(i)  der  blaue  Himmel  / the  blue  sky 

(ii)  die  Bldue  des  Himmele  / the  blue  of  the  sky 

In  the  semantic  representation,  the  only  difference  betueen  them  is  the 
MOOIFIERS  register. 

Another  group  level  thematic  feature  is  the  distinction  betueen  objecte, 
relations  and  properties.  Objects  and  relations  can  both  be  seen  as  bundles 
of  properties;  in  defining  them,  ue  are  making  a commitment  to  a coherent 
uorld  vieu,  i.e.  to  some  sort  of  * identity"  in  the  case  of  objects  and  to  the 
assumption  uf  "relatedness"  instead  of  randomness  in  the  case  of  relations. 
This  conceptual  leap  of  faith  d068  not  seem  to  be  a conscious  choice  on  the 
part  of  an  Individual  speaker,  but  rather  a choice  that  is  built  into  the 
language.  The  reason  I say  language  here  instead  of  conceptual  structure  is 
that  it  is  possible,  for  example,  that  the  concept  of  "objecthood"  differs 
from  language  to  language,  as  Uhorf  contends  in  his  analysis  of  Hopi  (36). 
Nevertheless,  for  the  translating  system,  the  object,  relation  and  property 
dietlnction  is  expected  to  be  maintained  in  the  deductive  data  base. 
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(i) 


Figure  4.10 

This  is  because  the  distinction  seees  to  be  integral  to  both  English  and 
German.  If,  in  fact,  languages  do  distinguish  objects,  relations,  and 
properties  In  different  uays,  and  If  this  reflects  deep  conceptual  differences 
as  uell,  then  the  conceptual  representation  chosen  here  is  heavily  language 
dependent  in  this  respect. 

Finally,  the  discourse  categories  "given*  and  "new,"  which  belong  to  what 
Hal  I i dag  calls  the  inforaation  systee,  also  appear  as  a group  level  theeatlc 
feature.  Since  this  systee  is  realized  priaarily  phonological  I y,  only  certain 
aspects  of  information  organization  are  going  to  be  relevant.  GIVEN 
information  is  that  which  the  speaker  (writer)  thinks  the  listener  (reader) 
can  deduce,  either  because  it  has  been  stated  explicitly  or  because  ft  Is 
common  knowledge  or  because  it  Is  in  some  sense  unique,  etc.  NEU  information, 
on  the  other  hand,  is  the  reason  for  the  writer's  sentence,  i.e.  the 
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information  which  he  wishes  to  communicate  to  the  reader. 

One  place  where  the  given-new  distinction  is  reflected  in  text  it  in 
definite  and  indefinite  determiners.  The  difference  between  the  noun  groupe 
under  I i ned 

(I)  Das  Buch  ist  verschwunden.  / Ib£  book  has  disappeared. 

(ii)  Bin  Buch  ist  verschwunden.  / fi.  book  has  disappeared, 
is  that  in  ( i ) , the  reaoer  is  expected  to  know,  or  very  soon  find  out,  which 
book  ie  meant,  while  in  (ii),  he  ie  not.  All  semantic  nodes  correeponding  to 
noun  groups,  then,  are  marked  by  the  translating  system  with  either  GIVEN  or 
NEU.  Note  that  this  means  that  some  relations  and  properties  are  aleo  narked 
along  the  way,  i.e.  those  that  are  expressed  as  noun  groups:  "dae  Schwimmen" 

/ “swimming",  "die  Bldue"  / "the  blueness."  Pronouns,  of  course,  are 
automatically  GIVEN,  since  their  referent  is  always  expected  to  be  derivable, 
either  when  they  appear  (for  back  reference)  or  as  eoon  as  more  of  the 
sentence  has  been  processed  (for  forward  reference). 

Another  place  that  the  information  focus  system  is  reflected  In  text 
(although  it  is  not  now  handled),  is  shown  in  the  following  example: 

(i)  der  blaue  Klotz  / the  blue  block 

(ii)  der  Klotz,  dsr  blau  ist  / the  block  that  is  blue 

One  important  difference  between  these  two  is  that  the  entire  noun  group  in 
the  first  example  must  be  GIVEN;  while  in  the  second,  the  subordinate  clauee 
allows  "blue"  to  be  NEU,  even  though  the  rest  of  the  noun  group  Ie  GIVEN. 

At  the  word  level,  then,  there  is  connotation,  and  at  the  group  level 
there  are  the  distinctions  between  head  and  modifiers  and  between  objecte, 
relations,  and  properties.  These  two  group  level  distinctions  also  appear  at 
the  clause  level.  Finally,  while  the  Information  focus  system  ie  properly 
discourse  level,  the  given-new  distinction  is  represented  both  at  the  group 
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and  at  the  clause  level.  Note  that  two  other  registers  in  the  semantic 
representation  related  to  information  focue  are  COREF  «.nd  PARALLELS,  uhich 
uere  discuss*'!  in  section  4.8  above. 

4.9.3  Thematic  Organization  at  the  Clause  Level 

An  important  clause  level  thematic  system  ie  the  theme-rheme 
distinction.  In  terms  of  Halliday'e  definition,  the  theme  ie  the  firet 
constituent  of  the  clauee.  In  the  translating  system,  therefore,  the  theme  ie 
marked  by  the  syntactic  component  when  the  clause  is  parsed,  but  it  ie  also 
given  a semantic  representation.  In  semantics,  the  theme  register  on  the 
clause  RSS  is  set  to  the  semantic  node  associated  uith  the  theme.  Halliday 
has  characterized  the  theme  as  "the  peg  on  uhich  the  meesage  ie  hung" 

(16, p. 161).  The  rheme  is  the  rest  of  ths  clause.  In  terms  of  the  information 
structure,  the  theme  ie  often  GIVEN,  as  in: 

0i£  Chromatobhoren  spielen.  / Ihs  chroma toohores  play. 

This  ie  not  always  the  case,  however,  as  shown  by  this  sentence  from  the 
sample  paragraph: 

Nach  von  Hess,  sol  ten  sie  sich  uie  der  f oenblinde  hensch  verbal  ten. 
According  to  von  Hess,  their  (the  cephalopoda)  behavior  ie  like  that  of  a 
color-blind  man. 

From  the  reader’s  viewpoint,  theme  acts  as  a set  of  directions  foi* 
interpreting  'he  information  :n  the  sentence.  Uhsn  the  theme  is  GIVEN,  the 
writer  ie  saying,  "Here  is  a concept  with  which  you  are  familiar,  on  which  you 
can  hang  the  information  I am  going  to  give  you."  On  the  other  hand,  when 
theme  is  NEU,  the  writer  is  setting  the  scene,  giving  information  he  coneidara 
helpful  or  essential  to  interpreting  what  will  be  said  in  the  rest  of  the 
sentence.  In  the  example  given,  it  is  important  for  the  author  to  qualify  hie 
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statement  by  attributing  it  to  von  Hess.  In  essence,  he  is  saging,  "Don't 
accuse  I believe  uha*  ! an  going  to  tell  you."  In  the  example  sentence,  thie 
qualification  is  also  expressed  lexically  by  the  use  of  the  verb  eo  1 1 en 
("supposed  to  oe").  In  fact,  the  author  goes  on  to  give  evidence  that  some 
equids  do  perceive  color. 

Another  theeatic  eechaniss  that  relotes  to  uhat  the  reader  ie  expected  to 
do  uith  the  inforeation  he  is  given  is  uhat  I ulil  call  the  reetrict-descr ibe 
distinction.  Basically,  a head-sod h i er  type  relation  is  RESTRICT  if  the 
Modifier  ie  expected  to  give  the  reader  useful  or  eseential  help  in 
identifying  the  HEAD.  DESCRIBE  information  nay  aleo  be  isefui,  but  it  ia 
treated  by  the  uriter  as  supplementary  information.  A relation  hae  the 
attribute  RESTRICT  uhen  modifiers  are  used  to  limit  the  reference  of  the  head. 
"Der  rote  Pul  II"  ("the  red  sueater"),  for  example,  exhibits  thie  kind  of 
relation,  since  not  all  sueatera  are  red,  end  the  adjective  hae  been  used  ae  a 
dietinguisher.  "Die  rote  Feusrsprl tie"  ("the  red  fire  engine"),  on  the  other 
hand,  uould  probably  be  a DESCRIBE  relation.  This  is  because  red  ie  generally 
a property  of  fire  engines,  and  so  the  modifier  has  been  used  purely 
descriptively,  rather  than  as  an  attenpt  to  single  out  a particular  object. 
Thie  dietinction  is  reflected  syntactical ly  in  the  English  restrictive  and 
non-restrictive  ciausesj 

(a)  Cephalopoda  that  live  in  coastal  areas  build  their  houses  out  of 
stones. 

(b)  Cephalopoda,  uhich  live  In  coastal  areas,  build  their  houses  out  of 
stones. 

In  (a),  the  subordinate  clause  is  ussd  as  a distinguishes  uhile  In  (b)  it 
gives  supplementary  descriptive  information.  Note  that  English  requires 
commas  for  (b)  but  not  for  (a),  and  the  distinction  ie  often  emphasized  by 
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contrasting  that  and  which.  In  German,  on  the  other  hand,  the  tranelation  for 
both  (a)  and  (b)  would  bei 

Die  Kraken,  die  in  der  KGstenzone  leben,  bauen  ihre  UohnhShle  aus 

Steinen. 
or  better  - 

Die  In  der  KQstenzone  lebenden  Kraken  bauen  ihre  UohnhAhle  aue  Steinen. 
Since  both  tgpes  of  clauses  have  the  same  surface  realization,  sonant ic 
knowledge  must  be  used  to  Make  the  distinction.  Here  we  have  a situation 
where  semantic  interpretation  is  necessary  for  Gernan  to  English  translation, 
since  if  we  are  to  choose  the  correct  English  representation  for  such  a 
clause,  we  must  interpret  the  German  correctly. 

Another  clause  level  feature  is  the  register  INFO-ORDER.  If  one  had  to 
classify  this  register,  it  would  be  assigned  to  the  information  focus  syetem, 
although  the  INF0-0R0ER  register  itself  is  a very  ad  hoc  measure.  The 
s^antic  component  checks  the  semantic  cases  of  adverbiale  in  the  clause  and 
marks  INFO-OROER  accordingly.  If  the  adverbial  ordering  ie  the  default  one, 
the  register  is  set  to  IWHARKEO.  If  the  ordering  Is  not  the  default  one,  then 
the  register  is  set  to  a list  of  the  RSS’s  of  ths  adverbiale,  in  the  order  of 
their  appearance  in  the  sentence.  Presumably,  those  nearest  to  the  end  of  the 
clause  are  considered  most  important  by  the  speaker  (unless  there  ie  some 
other  reason  for  the  ordering,  like  abundant  modifiers),  and  thie  might  be 
useful  information  to  preserve  for  the  generator. 

One  last  thematic  category  used  at  the  clause  level  Is  CLAUSE-TYPE,  which 
is  a register  set  on  the  RSS  corresponding  to  the  clause.  This  register  may 
have  the  values  C0TC1AN0.  QUESTION,  STATEMENT,  or  SECONDARY.  It  is  assumed 
that  this  information  will  be  used  by  the  generator  and  also  by  the  deductive 
component.  Ue  would  expect  the  deductive  component  to  know  something  about 
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the  iepii cat  ions  of  the  type  of  clause  used,  i.e.  the  presuppositions  and 
expectations  associated  uith  it.  For  connected  text,  this  sort  of  indorsation 
would  primarily  be  useful  for  disasbiguat ion,  i.e.  to  indicate  the  nags  the 
inforaatior.  in  a clause  cou'd  be  used  in  deduction.  For  More  interactive  ueee 
of  ianguage,  the  expectations  associated  uith  CLAUSE-TYPE  would  indicate  the 
type  of  action  that  Must  be  performed,  e.g.  carrying  out  a task,  finding  an 
answer,  etc. 

4.9.4  Discourse  Semantic  Structures 

Original  iy,  I planned  a separate  discourse  semantic  structure  (DSS)  which 
was  to  be  associated  uith  each  sentence  and  carry  Information  about 
intersententiai  relationships.  Except  for  the  information  system  treated 
above,  however,  vary  iittie  of  this  seems  to  be  derivable  from  the  eurface 
structure  of  a t»xt.  I will  defer  a discussion  of  discourse  ievei 
structuring,  then,  to  section  5.7. 

4,10  The  Place  for  Cass 

A case  grammar  in  the  style  of  Fillmore  usee  semantic  case  information 
for  several  purposes.  For  some  of  these  functions,  I have  used  other 
mechanisms  in  the  system.  Uhen  particular  prepositions  are  required  by  the 
verb,  for  example,  the  collocations  list  is  used  (section  4.5  above).  For 
objects  of  the  verb  in  general,  1 have  ignored  case  entirely,  assuming  that 
this  information  would  be  used  at  the  deductive  !evei.  Uinograd* e system  has 
the  case-iike  global  variable  SflLOC  (location),  which  is  bound  to  a location 
required  by  the  verb,  as  in  "Put  the  book  qq  iba  table,  fly  system,  in 
contrast,  uses  only  SHONE,  SflTUO,  and  SfITHRBE  to  specify  participants  in  a 
relation.  This  was  done  because  selection  reetrictione  filled  the  role  of 
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case  here;  SHLOC  and  the  other  globale  that  one  could  add,  like  tine  and 
manner,  were  redundant. 

Semantic  case  does,  however,  have  a place  in  the  translating  system, 
although  in  giving  it  one  ! have  extended  the  meaning  of  the  term.  For  the 
rest  of  the  section,  let  us  consider  modifying  relations  exclusively.  In  the 
system,  selection  restrictions  specify  the  constraints  a modifier  placee  on 
its  head.  In  addition,  we  also  need  a way  to  express  the  types  of  modifiers 
that  a head  can  take.  For  example,  ws  might  want  to  specify  that  evente  can 
be  modified  by  location,  time,  and  manner,  or  that  physical  objects  may  have 
shape  and  color.  These  constraints  are  not  now  implemented,  since  I expect 
them  to  be  embedded  in  the  deductive  routines.  Uhat  is  implemented  is  the 
characterization  of  the  individual  modifying  relations  by  high  level 
categories  which  I will  call  semantic  cases*  orientation,  location,  ehape, 
etc. 

Uhi  le  the  constraints  on  modifiers  have  not  been  implemented,  semantic 
case  information  does  have  other  uses  in  the  system;  the  rules  for  ordering 
modifying  relations  are  expressed  in  terms  of  case.  That  is  "die  graue  groese 
Tintenfisch"  ("the  grey  big  squid")  sounds  strange  in  both  German  and  Englieh 
because  the  rule  "size  before  color"  has  been  violated.  (Note  that  we  may 
need  more  generality  than  the  simple  case  categorieu  to  express  all  the 
ordering  rules,  but  at  least  case  goes  a long  way  toward  expressing  the  more 
common  regularities  that  occur.)  Cass  also  helps  to  explain  verb  modifier 
ordering.  In  German  we  would  be  more  likely  to  say  "Uir  traffen  uns  gestern 
(time)  in  London  (location),"  while  in  English  the  more  frequent  arrangement 
would  be:  "Ue  met  in  London  (location)  yesterday  (time)."  I should  add  that 

right  now  the  German  end  of  the  system  does  nothing  more  with  case  than  find 
it.  The  semantic  component  does  not  care  whether  it  sees  "die  groese  graue 
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Tintenfisch"  or  a "graue  grosse*  one.  These  rules,  of  course,  could  be  added 
easily  enough.  Semantic  case  information  does  have  a place  in  generation, 
houever,  since  modifier  ordering  rules  ir  the  target  language  are  expressed  In 
terme  of  case. 

The  mechanism  for  retrieving  semantic  case  information  Is  a simple  one. 
Since  I am  assuming  that  different  concept  markers  always  Imply  different 
cases,  the  logical  place  for  case  information  is  the  selection  restriction 
tree.  To  build  the  semantic  representation  for  a relation  concept  marker  that 
acts  as  a modifier  (including,  of  course.  flHAVE-PROPERTY) , we  trace  up  the 
selection  restriction  tree  until  a marker  is  found  with  its  CASE  property  set. 
Semantic  cases  are  associated  with  subtrees  of  the  selection  restriction  tree, 
although  there  may  be  several  cases  along  a branch.  This  allows  us  to  handle 
exceptions,  since  the  first  case  found  is  the  one  used. 

*** 

In  this  chapter  we  have  discussed  the  semantic  representation  at  d the  way 
a set  of  representations  are  associated  with  individual  sentences.  The  next 
chapter  discusses  some  of  the  issues  that  must  be  considered  If  we  are  to 
choose  a single  interpretation  for  a given  sentence. 
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Chapter  5 — The  Role  of  Understanding 
S.l  introduction 

The  procsss  of  understanding  a sentence  nay  be  thought  of  as  the  process 
of  relating  it  to  an  internal  knouiedge  structure.  As  uas  already  mentioned, 
the  translating  systea  Implesented  makes  no  gesture  touard  understanding,  but 
inetead  by-passes  the  problem  entirely  (with  the  possible  exception  of 
selection  restrictions).  This  omission  arises  not  out  of  the  belief  that 
understanding  is  unimportant  to  translation,  but,  rather,  out  of  the 
conviction  that  a fragmentary  solution  is  no  solution  et  ell.  Uhile  the 
understanding  component  for  the  system  remains  a "black  box,"  the  mechanism 
needed  to  fill  this  gap  ,a  not  as  ill-defined  as  It  once  uas.  Recent  uork  by 
Minsky  (27),  Charnlak  (2),  Goldstein  (9),  McDermott  (28).  and  Sussman  (34)  ie 
extremely  exciting,  and  constitutes  substantial  progress  touard  a theory  of 
repi  ssenting  and  structuring  knouiedge. 

The  chapter  that  follous  relies  heavily  on  the  ideas  in  the  references 
cited  above,  but  I uiil  be  considering  much  more  restricted  questions.  Firet, 
given  the  system  that  Is  described  here,  uhat  sorts  of  interactions  uould  ue 
expect  betueen  a knouiedge  structure  and  the  rest  of  the  system?  Second,  I 
Mill  take  a short  look  at  the  sorts  of  special  problems  that  come  up  In  text 
and  some  of  the  cuss  ue  can  take  advantage  of.  In  uhat  follous,  I ui  1 1 refer 
to  our  "black  box"  as  the  deductive  component,  although  this  term  is 
misleading.  Deduction  is  probably  an  important  part  of  understanding,  but  not 
necessarily  the  primary  mechanism.  I uss  the  uord  "deduction"  Instead  of 
"understanding,"  housver,  since  the  interactions  outlined  betueen  the 
component  and  the  system  here  might  not  be  identical  to  the  interactione 
betueen  a more  general  " under e tender”  and  a system’ e linguistic  components. ' 
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In  what  follows,  I will  assume  that  the  deductive  component  ie  written  in  a 
language  with  at  least  the  representational  power  of  Conniver. 

5.2  The  Basic  Functions  of  the  Deductive  Component 

Understanding  plays  a crucial  role  at  the  interpretive  end  of  the 
translating  process:  we  need  to  understand  in  order  to  decide  which  sense  of 

a word  is  intended,  to  untangle  pronoun  references,  and  so  on.  Ue  would 
therefore  expect  strong  interaction  betueen  the  deductive  component  and  the 
parsing  and  semantic  components.  As  will  be  discussed  in  the  next  chapter,  we 
might  also  need  to  draw  on  our  general  Knowledge  structure  for  generation  - in 
particular,  when  paraphrase  ! j necessary.  Thii  ssems  to  be  a more  specialized 
mechanism,  but  I am  not  prepared  to  discuss  it  further,  so  1*  ’ill  not  be 
considered  here.  This  leaves,  then,  the  interpretive  role  of  the  deductive 
component,  which  can  be  divided  into  two  functions:  disambiguation  a~d 
supplying  information  that  is  Implicit,  but  not  explicit,  in  text.  In  terms 
of  the  system  here,  thess  tasKs  can  be  reformulated  as  choosing  between 
possible  semantic  representations  and  filling  In  the  slots  le*t  open  in  them 
(the  AUNSPEC  marker).  These  processes  are  not  independent,  but  rather 
intimately  interrelated.  Clearly,  s chsire  between  representations  is  made 
easier  when  all  the  information  is  In.  On  the  other  hand,  we  can  make  a 
decision  about  implicit  information  only  when  we  have  committed  ourselves  (at 
least  temporarily)  to  a particular  context.  The  situation  is  not  as 
hopelessly  circular  as  my  presentation  of  it;  I merely  wish  to  emphasize  that 
implicit  information  can  hava  its  uses  in  disambiguation,  and  disambiguation, 
in  turn,  ui  1 1 supply  implicit  information. 

Ue  cannot  rt  'ly  ask  how  the  deductive  component  will  interact  with  the 
rest  of  the  system  before  we  ask  when  it  will  do  so.  Ideally,  of  course,  the 
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understanding  section  of  the  system  would  be  active,  directing  the  parse. 

Since,  however.  text  interpretation  ie  still  at  the  stags  where  syntactic 
information  ie  usually  the  best  information  available),  the  question  is  really 
when  the  semantic  component  should  call  deduction.  A.  likely  place  to  make  the 
call  ie  at  the  end  of  each  semantic  specialist,  so  that  bad  representations 
c 'in  be  eliminated  right  away  end  do  not  have  to  be  carried  forward.  In 
addition,  if  all  representations  are  rejected  by  deduction,  we  have  eome  good 
information  to  sond  the  career.  The  sooner  deduction  realizes  the  irror,  the 
Isee  complicated  backup  will  be,  since  ws  are  still  at  or  near  the  scene  of 
the  di f f icul ty. 

Understanding  is  not,  however,  a single  monolithic  process.  Some 
linguistic  structures  require  a delay  in  parte  of  the  process.  For  example, 
where  in  English  we  would  say,  "Give  me  ihft  Ud  cenc  i I and  the  p)qp  one. " the 
German  could  be.  "Gib  mir  dsn  roten  und  dan  b I auen  Bleistift"  (literal  ly, 

"Give  me  the  red  and  the  blue  Dene i I* > . Here,  the  first  noun  group  in  the 
conjoined  etructure  cannot  be  fuliy  evaluated  until  the  second  hae  been  parsed 
and  evaluated.  Similarly,  a German  end-order  clous®  construct  requires  that  a 
goed  part  of  the  processing  cf  the  clause  must  wait  for  the  main  verb  to  be 
pars-.J.  Constraint  number  one  on  cur  deductive  component,  then,  is  that  it 
cannot  be  an  all-or-nothing  process.  Information  should  be  usable  as  it  ie 
accumulated.  The  deductive  component  might  be  able  to  reject  some  poecible 
semantic  representations  for  a given  noun  group  before  the  reet  of  the 
sentence  has  been  evaluated,  but  a more  likely  function  would  be  to  reshuffle 
the  priorities  of  different  possibilities.  This  updating  process  will  be 
discussed  further  In  eection  5.4.  Related  to  the  use  of  partial  information, 
we  would  also  want  to  activate  Information  not  just  for  full  grammatical  units 
(e.g.  noun  group,  clause,  etc.),  but  also  at  certain  important  intermediate 
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points,  for  example,  as  soon  as  a verb  ie  found.  Thue,  the  i ftp  I ostentation  of 
the  deductive  coaponent  outlined  here  would  also  require  some  changee  in  the 
seeantic  special iete  currently  in  the  system. 


5.3  Relating  a Sentence  to  the  Knowledge  Structure 
It  ie  aesumed  that  the  deductive  component  will  be  activated  by  an 
approach  similar  to  that  used  In  Uinograd's  system.  Each  possible  eemantic 
representation  of  a sentence  is  converted  into  a set  of  assertions  for  the 
deductive  data  base,  and  procedures  are  automatically  built  from  these 
assertions  to  perform  the  necessary  d^uctive  processing.  Conversion  of  the 
semantic  representation  to  an  assertion  set  is  straightforward.  The  variable 
in  an  OSS  is  combined  with  the  concept  marker  and  the  relation  U\ S,  *or 
example,  (01S  XI  ^OCTOPUS).  Each  such  tuple  is  given  its  own  assertion  name, 
as  well,  and  an  assertion  name  can  appear  as  an  argument  in  other  tuples.  For 
RSS’e,  the  relation  concept  markers  are  combined  with  the  variables  of  their 
arguments  (if  these  are  OSS’s)  or  the  assertion  names  of  the  relations  formed 
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Figure  5.1 


12S 


fro*  arguments  (if  these  are  RSS’a).  Finally,  Modifying  relations  are  given 
assertions  based  on  concept  Markers  and  assertions  based  on  case.  Figure  S.l 
is  an  exaaple  of  the  assertions  that  could  be  produced  for  a Modifying 
relation.  For  the  special  case  of  the  Modifying  relation  /WAVE-PROPERTY,  ue 
build  only  one  assertion,  naaely  one  Made  up  of  the  case  of  the  property,  the 
variable  or  assertion  naae  of  the  head,  and  the  property's  concept  Marker. 
Figure  5.2  gives  an  exaeple  of  this.  These  assertions  do  not  represent  all 
the  InforMatlon  In  the  semantic  representation,  and  it  is  expected  that  the 
procedures  ui  1 1 use  theaatlc  intorMatlor.  as  they  go  about  turning  the 
assertion  set  into  routines  to  be  used  by  the  deductive  coeponent.  Just  hou 
this  will  be  done,  housver,  seeas  to  depend  very  auch  on  the  uay  general 
knowledge  is  to  be  structured,  so  I uill  not  consider  the  question  further 
here. 


A5s  ms  X3  0ELEOONE) 

ASt  (COLOR  X3  CRAY  1 SH-YELLOU) 

Figure  5.2 

Uhen  tuples  like  those  given  above  are  asserted  in  the  deductive  data 
base,  it  Is  expected  that  they  uill  trigger  all  or  soae  part  of  the  related 
information  that  is  stored  as  perManent  knowledge.  In  the  eiaple  hierarchic 
Model  froa  Chapter  3,  this  uould  involve  a chain  reaction  up  through  the 
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hierarchies,  so  that  (#!S  XI  0OCTOPUS)  would  trigger  the  assertion  (#IS  XI 
/WATER-ANIMAL) , <0IS  XI  tt INVERTEBRATE!,  (#IS  XI  flANIMAL) , etc.,  along  with  the 
related  information  in  each  case.  Most  assertions  will  be  More  complicated 
than  these  At! S tuples,  and  ue  will  want  to  he  able  to  record  Information  about 
the  status  of  an  assertion,  e.g.  under  what  conditions  an  assertion  can  be 
expected  to  hold.  Certain  minimal  distinctions  are  essential.  Firet,  ue 
would  want  to  distinguish  between  a relation  that  ue  know  does  not  hold  and 
one  about  which  ue  simply  have  no  information.  In  addition,  ue  want  to 
distinguish  between  a relation  that  is  unasserted  but  could  hold  for  a 
situation,  and  one  that  is  not  only  unassorted,  but  also  irrelevant.  For 
example,  ue  can  ask  "Uhere  did  Harvey  put  the  book?”  out  not,  "Uhere  did 
Harvey  put  the  rapidity?”  Location,  of  course,  is  relevant  for  concrete 
objects  but  undefined  for  abstract  ones.  Furthermore,  ue  uould  also  want  to 
qualify  assertions  in  the  ”yes”  and  "no"  states,  by  the  sources  of  the 
information,  the  times  the  assertions  are  In  this  state  (sometimes,  often, 
Mondays  only),  etc.  The  minimal  number  of  different  assertion  states,  then, 
is  fourt  "yes"  (It  holds),  "no"  (It  does  not  hold),  and  two  varietes  of 
"unasserted,"  either  "defined"  or  "undefined."  In  general,  it  Is  probably  a 
non-trivial  task  to  determine  whether  or  not  a relation  uould  make  sense  If  It 
uere  asserted,  but  certain  broad  distinctions  can  be  made. 

5.4  Positive  Selection  Restrictions 
The  use  of  a verb  raises  certain  expectations  about  the  nature  of  the 
participants  involved.  Similarly,  attributive  adjectives  raise  expectations 
about  the  noun  modified,  and  prepositions  carry  constraints  on  their  objects. 
The  selection  restrictions  introduced  in  chapter  3 allowed  us  to  exprese 
minimal  conditions  on  participants  in  a relation,  but  there  is  more 
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information  that  is  potentially  useful.  For  example,  if  ue  know  one  of  the 
participate  in  a relation,  ue  often  have  a much  better  idea  of  what  the 
others  might  be.  Let  us  cali  the  restrictions  from  chapter  3 negative 
eelection  restrictions,  and  define  a positive  selection  reetriction  to  be  a 
block  of  information  about  the  expected  participants  in  a relation  that  can  be 
used  by  the  deductive  component  to  decide  bstuesn  possible  Interpretations  of 
an  utterance.  I ,r>  ue  try  to  specify  more  closeiy  uhat  positive  eelection 
restrictions  should  look  like,  ue  run  into  some  issues  uhich  ue  did  not  have 
to  face  uhen  dealing  uith  their  comparatively  simple  negative  counterparts. 

As  mentioned  above,  if  all  possible  semantic  representations  for  a phr.ise 
are  rejected,  the  parse  Itself  ui'l  be  rejected.  Since  ue  might  expect 
positive  restrictions  to  be  rather  intimately  related  to  the  general  knouledge 
structure,  us  could  find  ourselves  in  a situation  uhere  an  incorrect  statement 
by  the  author  violates  the  restrictions  and  is  sent  back  to  be  reparsed.  This 
is  obviously  undesirable:  the  deductive  component  should  distinguish  betueen 
false  statenents  and  nonsensical  ones,  at  least  as  much  as  possible.  Note 
that  nonsense  uill  be  considered  a misparsing  here,  since  I am  assuming  that 
uhen  a nonsensical  statement  actually  appears  in  text  (as  in  children's 
stones  or  a discussion  of  "colorisss  green  ideas”),  ue  uill  have  been 
adequately  uarned  by  context.  An  example  of  the  potential  confusion  of 
nonsense  uith  misstatements  uill  probably  be  helpful  here. 

Eingehende  Untersuchungen  Ober  einen  etualgen  Farbensinn  der 
Cephalopoden  sind  sehr  eruQnscht. 

Thorough  investigations  on  the  existence  of  a sense  of  color  in 
cephalopods  uould  be  very  desirable. 

Let  us  assume  that  eruQnscht  is  defined  by  the  concept  marker  0UISH-FOR  (Ue 
might  uant  something  more  precise,  but  this  uill  do.?,  and  that  the  first 


128 


argument  here  is  the  generalized  ^PERSON  Modified  by  #ANY.  To  specify  the 
second  reject,  ue  would  give  it  the  negative  restriction  ^RELATION  and  treat 
the  situation  where  an  object  appears  in  this  place  as  the  sort  of  ellipsis 
discussed  in  section  4.7.3.  Uhat  else  can  be  said  about  relatione  that  are 
wished  for?  One  important  factor  is  that  the  relation  does  not  now  hold,  or 
at  least  the  speaker  believes  that  it  does  not  now  hold.  If,  in  fact, 
conclusive  studies  of  cephalopod  color  perception  did  exist  at  the  tine  this 
article  was  written,  the  reader  nu9t  assume  that  the  author  did  not  know  about 
them.  Our  knowledge  of  these  hypothetical  studies  would  not,  however,  block 
the  interpretation  of  the  sentence  altogether. 

It  '19  harder  to  envision  bomb  positive  restrictions  becoming  involved  in 
misstatements  than  others.  Our  "uish-for"  example  is  probably  a fairly  common 
candidate  for  miestateMent.  On  the  othe-  hand,  the  exchange  in  (ii)  ie  quite 
a bit  less  likely  to  occur  than  the  one  in  ( i ) : 

(i)  Harry  is  a bachelor.  --  No,  he  got  married  Saturday. 

(ii)  Jane  i9  a bachelor.  — No,  she’s  a female. 

A mistake  about  marital  status  is  presumably  easier  to  make  than  one  about  the 
eex  of  an  individual. 

For  positive  selection  restrictions,  then,  our  knowledge  etructure  ehould 
provide  a mechanism  to  evaluate  how  likely  a speaker  is  to  make  a mistake, 

Thi9  mechanism  could  take  the  form  of  a value,  function,  or  procedure 
associated  with  each  restricticn  to  calculate  the  probability  that  the 
restriction  will  be  violated  in  the  given  context.  Ue  might  not  need 
completely  explicit  information  here  about  the  likc'itood  of  violation,  since 
eome  of  it  might  be  deducible  from  the  knowledge  structures  if  knowledge  in 
the  eystem  is  arranged  so  that  certain  farts  mi~.h  less  prone  to  mistakes 
than  others,  then  the  system  could  assume  that  ♦«  . writer  is  also  much  leee 
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likely  to  sake  mieetatementa  of  this  variety.  Of  course,  this  Mould  only 
serve  as  a take-off  point,  since  particular  context  (e.g.  whether  a child  le 
writing)  or  other  eisstateeents  froa  the  ease  source  eight  alter  our 
expectations  about  the  likelihood  of  particular  errors. 

Interested  readers  are  referred  to  McDermott  (26)  which  treats  questions 
of  belief  and  doubt  in  the  assist lation  of  new  information. 

5.5  Filling  In  the  Blanket  Dealing  with  MJNSPEC 
Ue  have  said  that  in  addition  to  deciding  between  poeeible 
representations,  the  deductive  component,  should  be  able  to  supply  information 
that  has  been  left  implicit  in  the  text.  In  the  Implementation,  It  has  been 
assumed  that  such  implicit  information  coses  in  two  varieties!  Information 
that  will  be  necessary  in  generation  and  information  that  will  not. 

Therefore,  a lot  of  implicit  information  will  not  be  reflected  In  the  eemantic 
representation  at  all.  Consider  the  examples! 

flerkur  flog  nach  Athen.  / Mercury  flew  to  Athens. 

Lindbergh  flog  nach  Paris.  / Lindbergh  flew  to  Paris. 

Every  object  has  an  implicit  time  setting  and  duration.  If  the  Mercury  here 
is  the  historical  one,  we  would  have  good  evidence  for  assuming  that  he  made 
the  trip  under  hie  own  power,  since  the  airplane  had  not  yet  been  invented. 

On  the  other  hand,  since  Lindbergh's  flight  postdated  the  Invention  of  the 
airplane,  it  would  be  highly  unlikely  that  the  flying  here  ie  done  In  any 
other  way  than  in  an  airplane.  (Knowing  that  Mercury  had  wings  on  his  feet 
and  that  Lindbergh  made  the  first  U.S.  to  Paris  nonstop  solo  flight  would  be 
even  better  information,  of  course,  but  that  Is  not  the  point  here.)  Implicit 
noun  tense,  then,  seems  to  be  useful  information  for  disambiguation. 

Since  implicit  noun  tense  seems  useful,  should  it  also  have  a place  In 
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the  semantic  representation?  Ch'fe’e  group  at  the  University  of  California  at 
Berkeley  has  identified  the  question  of  Implicit  information  ae  an  important 
one  for  translation.  In  the  Cerman-Engl ish  language  pair,  I have  not 
encountered  any  instances  where  the  "tense*  of  objects  must  be  explicitly 
represented  in  the  semantic  representation  in  order  for  smooth  translation. 
(There  may,  of  course,  be  "emergency  situations"  where  the  generator  cannot 
find  a well-formed  translation  and  might  need  to  make  additional  calls  to  the 
deductive  component,  but  right  now  I am  only  considering  case  in  which  the 
generator  is  successful.)  My  system  is  based  on  the  assumption  that  for  a 
given  target  I anauaae  we  can  predict  which  implicit  information  will  be 
required  for  generation  and  which  will  not.  It  will  be  interesting  to  see 
whether  thie  assumption  of  the  predictability  of  explicit  information  ie 
coirect.  I should  note  that  because  of  this  assumption,  the  semantic 
representation  in  the  system  is  highly  language  dependent;  that  is,  dependent 
on  the  two  languages  involved.  Ue  might  expect  a system  with  languages  lee® 
closely  related  than  German  and  English  to  have  very  different  information  in 
a semantic  representation  and  to  differ  considerably  from  the  present  system 
in  its  representation-building  behavior. 

Ue  can  say-  then,  that  the  deductive  component  will  be  supplying  implicit 
information  both  for  its  own  purposes  and  to  add  to  the  semantic 
representation  for  the  generator.  Let  us  concentrate  on  the  information  that 
will  clearly  be  necessary  for  generation  and  ask  how  it  can  be  supplied.  In 
section  4.7.2  we  discussed  the  use  of  MJNSPEC  for  things  like  tines, 
locations,  agents,  etc.  Uith  a mechanism  such  ae  that  proposed  by  Minsky 
(27),  thie  sort  of  information  would  be  supplied  by  a rich  default  structure. 
Of  course,  a default  need  not  be  completely  specified  by  the  internal 
structure.  For  example,  us  might  choose  a general  default  for  the  location  of 
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an  object  to  be,  "If  there  le  no  reason  to  think  otherwise  and  the  location  of 
the  object  has  been  specified  previously,  assume  It  Is  still  In  the  eame 
place,"  It  seems  fair  to  assume  that  defaults  will  usually  be  heavily  context 
dependent. 

In  chapter  4 we  suggested  the  use  of  flUNSPEC  for  elliptic  eltuatione 

where  a relation  was  implied  by  its  arguments.  There  seem  to  be  eeveral 

possibilities  here.  The  first  variety  appears  In  our  sample  paragraph; 

Ob  die  Cephalopoden  selbst  auf  Farben  reagieren,  ist  nlch  bekannt...  so 
echeint  das  zum  mindesten  fflr  dlese  Formen  ffln  einen  Farbensinn  zu 
sprechen. 

Uhether  the  cephalopoda  even  react  to  color  Is  not  known...  at  least  for 
these  species,  this  appears  to  support  & color  sense. 

The  full  relation  has  bsen  presented  directiy  or  can  be  Immediately  deduced 

from  the  context,  and  the  argument  of  the  relation  appears  later  as  an 

abbreviation.  In  the  example,  we  would  expect  the  deductive  component  to  use 

information  about  reacting  to  immediately  reformulate  the  first  sentence  ae  a 

question  of  uhether  cephalopoda  have  a sense  of  coicr.  Later,  when  we  eee  the 

reference  to  a color  sense,  we  can  check  context  and  supply  the  implicit 

relat ion(e) : 

(^SUPPORT 

A10 

(dHAVE -FACULTY  tfCEPHALOPOO  /TCOLOR -SENSE) ) 

Here,  A10  refers  to  another  assertion.  Thus,  with  good  understanding  of  what 
is  happening  in  the  text,  this  sort  of  ellipsis  can  be  handled  in  a 
straightforward  manner. 

For  implied  relations  that  are  not  immediately  supplied  by  context,  the 
system  will  need  a more  general  mechanism  for  finding  a typical  relation  given 
one  or  more  of  its  arguments.  Ue  will  see  this  mechanism  used  again  for 
compound  nouns  below.  I suspect  that  these  non-contextual  implied  relatione 
will  be  drawn  from  a rather  restricted  group,  with  relations  like  ^EXISTENCE- 
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OF  heading  the  list;  but  this  speculation  is  not  based  on  extensive  analyete. 
Note  that  eome  implied  relations  are  derivable  unambiguous  I y from  surface 
etrucf.re  (for  example,  the  English  "if  possible"  is  equivalent  to  "if  it  is 
possible").  Ue  Mould  expect  to  find  more  variety  in  semantic  representations 
for  these  cases,  but  they  are  not  relevant  right  nou,  since  they  Mould  not  be 
marked  with  KfUNSPEC. 

Finally,  let  us  consider  a use  of  the  MJNSPEC  marker  that  Mas  mentioned 
but  not  discussed  in  chapter  4.  Between  the  compounds  that  sre  linked  by 
completely  idiosyncratic  relations  and  those  that  are  linked  by  predictable 
relations  (WAVE-PROPERTY,  H1ATERIAL-0F,  WAVE-AS-PART,  etc.)  is  a group  of 
compounds  that  can  be  handled  uith  the  0UNSPEC  marker.  Consider  the  examples 
die  HaustOrschlOssel  - die  SchlQssel  fOr  die  HaustOr 
door  key  (instrument  + object  of  action  implied 
- here,  flffnen,  to  open) 

Here,  we  want  to  find  a relation  that  is  the  function  of  the  key,  i.e.  (0OPEN 
0KEY  0OOOR) . There  are  a whole  series  of  these  functional  compounds,  uhere 
the  relation  itself  is  unspecified.  So  once  again,  the  deductive  component 
uill  have  to  suppy  a typical  relation  when  given  Its  arguments.  Note  that  for 
the  0FUNCTION-OF  case  ue  are  not  asking  for  a uhole  neu  mechanism,  since  we 
would  expect  a knowledge  structure  to  have  strong  links  between  an  object  and 
its  function. 

Compounds  do  exhibit  relations  besides  0FUNCTION-OF  that  ue  might  want  to 
represent  by  0UNSPEC.  For  example, 

der  Handkoffer  - hand  luggage 

(luggage  that  can  be  carried  by  hand) 
der  Kabinenkof fer  - steamer  trunk  (literally,  cabin  trunk) 

(luggage  that  can  be  used  in  a ship's  cabin) 
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For  these  and  other  More  associational  compounds,  it  ie  not  clear  that  there 
is  only  one  relation  that  cm  describe  the  connection  between  the  compound's 
components.  It  seees  desirable,  however,  for  the  deductive  component  to 
supply  a likely  relation  or  relations  to  the  saeantic  representation.  Then, 
if  there  is  no  equivalent  compound  or  classifier  plus  noun  combination  in 
English,  the  generator  can  use  the  semantic  representation  to  produce  a clause 
or  parentheeized  explanation  to  describe  the  object. 

5.6  Other  Contributions  of  the  Deductive  Component 

Except  in  dealing  with  the  0UNSPEC  marker,  the  deductive  component  ie  not 
expected  to  alter  the  semantic  representation.  Ue  can  expect  it,  however,  to 
set  registers  on  semantic  nodes  with  information  that  will  be  useful  for 
generation.  In  particular,  this  information  would  include  categories  like 
Halliday's  known-unknown  and  variable-value  (13).  Final  choices  between  tha 
categories  restricx-deecribe  and  generic-particular,  would  also  be  made  by  the 
deductive  component,  as  well  as  decisions  about  coreference.  As  the  generator 
becomes  more  sophisticated,  there  will  no  doubt  be  other  categorise  that  we 
would  want  to  add  to  this  list. 

5.7  C‘ Motive  Processing  above  the  Sentence  Level 

In  order  to  decide  betwnen  semantic  representations,  the  deductive 
component  will  have  to  construct  a model  of  the  text.  Little  information 
above  the  sentence  level  is  currently  incorporated  into  the  semantic 
representation,  since  it  ie  not  yet  clear  how  such  information  can  be  ueed  in 
text  generation.  Nevertheless,  I think  it  is  worthwhile  to  take  a look  at 
some  structural  aspects  of  our  sample  paragraph.  As  we  can  r.  e from  the 
English  translation  on  page  15,  the  example  paragraph  can  be  divided  into  aim 
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sections.  These  divioione  can  be  characterized  as  foiloust 

1.  An  upuard  pointers  relating  what  is  to  come  to  what  has  come  before 
in  the  text 

2.  Uhat  it  i st  general  description  of  the  mechanism 

3.  Uhat  it  is  ussd  fort  function  or  use  of  the  mechanics 

4.  Uhat  causee  Its  how  to  activate  the  mechanism 

5.  Uhat  goes  with  it:  accompanying  actions 

6.  Issue:  can  cephalopoda  perceive  color? 

In  this  analysis,  sections  1-5  are  clearly  related,  and  one  Mould  expect  then 
to  be  handled  using  spscial  knouledge  of  the  uay  an  author  Mould  describe  a 
process  or  mechanism.  The  sixth  point  here  is  not  directly  related  to  the 
rest,  and  we  would  not  expect  the  process-description  handler  to  deal  with  it 
directly.  The  issue  of  color  perception  is  not,  however,  unrelated  to  the 
other  five  sections.  The  basic  reasoning  hsre  is,  "Cephalopoda  are  coior 
producers.  Are  thsy  also  coior  consumers  (l.e.  perceivers)?"  The  sixth 
section,  therefore,  investigates  ths  invsrss  of  a key  relation  in  the 
paragraph.  The  aesociatlonal  link  between  section  six  and  the  rest  of  the 
paragraph  is  a fairly  common  phenomsnon.  Similar  assoclationai  links  might  be 
used  to  Introduce  historical  information  or  to  maks  points  that  are  too  short 
to  merit  a new  paragraph  of  their  own.  From  this  analysis,  mb  can  conclude 
that  while  paragraphs  are  generally  organized  around  a single  topic,  we  cannot 
expect  a strictly  top-down,  ono-topic-per-paragraph  organization.  One  good 
heuristic  seems  to  be  to  look  for  assoclationai  links  near  the  end  of  a line 
of  description  or  reasoning  (where  the  six  segments  above  would  be  considered 
I Ines  of  description). 

Any  attempt  to  build  a model  of  the  sample  paragraph  would  also  have  to 
recreate  the  reasoning  used.  One  of  ths  patterns  we  see  in  the  paragraph  let 
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(i)  Generalisation:  X is  a cause  of  Y. 

(ii)  Evidence:  Example  where  X is  blocked  and  u change  in  Y is  observed. 

This  sort  of  reasoning  pattern  would  be  associated  with  causality,  and  it 
could  be  cued  lexically  by  "veranlassenden"  ("causing”  line  3 of  the  German 
text  on  page  13),  "bei"  ("upon,"  here  a causal  relation,  line  11),  "abhSngen 
von"  ("depend  on"  line  13),  and  "eine  Uirkung  aueOben"  ("exert  an  effect"  line 
19).  A variant  of  this  reasoning  pattern  - uhere  evidence  precedes 
generalization  - might  be  slightly  sore  difficult  to  handle.  It  is  obviouely 
easier  to  interpret  evidence  if  ue  know  what  it  is  evidence  of.  It  seems 
clear  that  at  the  paragraph  level,  too,  ue  ui  1 1 want  the  deductive  component 
to  handle  partial  information  as  it  is  accumulated. 

5.8  Metaphoric  Language 

Dost  types  of  text  that  would  be  considered  for  mechanical  translation 
probably  would  not  contain  phrases  like  "the  babbling  brook"  or  "the  raging 
storm,"  so  one  might  conclude  that  the  ability  to  handle  metaphoric  language 
is  not  important  in  a practical  system.  This  would  be,  I think,  an 
unfortunate  conclusion.  Metaphor  is  relevant,  because  it  is  part  of  the  more 
general  problem  of  the  creative  use  of  language.  In  metaphor,  ue  take  the 
definitions  of  the  individual  words  involved  and  suspend  some  of  their  rulee, 
while  transforming  others  slightly.  Metaphor  is  one  situation  in  which  a 
deductive  component  will  have  to  reason  by  analogy,  but  it  is  not  the  only 
one.  Often,  we  see  a phenomenon  similar  to  metaphor  in  uord  use.  Consider, 
for  example,  the  uord  Erreounaen  from  the  first  sentence  of  our  paragraph.  In 
a technical  sense,  as  it  is  used  here,  the  uord  means  an  electrical 
excitation,  or  impulse.  Uhen  talking  about  human  emotions,  Erreauna  can  mean 
agitation,  while  in  a social  situation  it  can  mean  commotion.  Ue  might  handle 
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thie  by  giving  three  different  definitions  to  the  uord  Erreaupq.  but  then  ue 
risk  ml eelng  the  common  ground  that  exists  between  these  three  senses  of  the 
word.  A knowledge  structure  should  be  able  to  represent  the  fact  that  the 
three  senses  are  analogous!  there  is  a disturbance  of  a state  of  rest  by  a 
phenomenon  that  is  unstable  or  unpredictable  in  come  sense.  Metaphoric 
language,  then,  seems  to  differ  fror  otner  sorts  of  language  uee  in  degree 
rather  than  in  quality. 

One  possible  difference  between  metaphor  and  normal  languaps  use  ie  that 
metaphor  ie  unpredictable.  Uhen  a new  metaphor  is  encountered,  ue  presumably 
have  to  call  in  our  a..;!ogy  pr  oessor  to  find  the  pointe  of  similarity  and  the 
points  that  are  irrelevant.  Once  the  senses  of  a uord  are  known,  houever,  it 
ie  not  clear  that  the  closeness  of  the  similarities  is  as  important  anymore. 
(There  could  be  the  usual  benefits  of  a shared  model  - economy  of  storage, 
uniformity  of  representation,  etc.  - but  it  is  not  clear  that  these  issues  are 
relevant.)  This  contrast  of  metaphor  and  regular  language  ignores  the  point 
that  language  usage  has  to  be  learned.  Uhen  we  encounter  the  uord  Erreounq  in 
a technical  sense  for  the  first  time,  ue  are  already  prepared  with  a set  of 
poseibi  I i ties  that  can  be  evaluated  to  determine  which  are  relevant  to  the  neu 
usage.  To  handle  both  metaphoric  language  and  other  more  common  sorts  of 
language  use,  then,  a deductive  component  will  need  to  be  able  to  inepect  and 
alter  uord  definitions  (or  some  model  of  them),  and  will  need  the  general 
ability  to  reason  by  analogy. 

A related  issue  here  is  that  of  "dead  metaphor."  Some  cliches  and 
idiomatic  expressions  have  lost  the  freshness  of  their  analogies,  and  ono 
might  conclude  that  the  original  senses  are  no  longer  relevant.  Some  English 
examples  might  be  "That  takes  the  cake!"  and  "He  was  bouled  over."  I have  no 
idea  of  the  original  senses  of  these,  although  it  wouid  probebly  be 
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interesting  to  find  out.  The  point  hare  is  that  us  can  still  use  such  phraser 
even  uhen  their  original  cospar i sons  are  unknoun  or  long  forgotten.  For  these 
sorts  of  dead  metaphors,  a system  should  probably  hook  the  phrases  directly  to 
their  intended  meanings,  without  worrying  about  analogies.  Thus,  the  firet 
.ample  would  have  roughly  the  same  meaning  as  "That’s  outlandish,"  and  the 
meaning  of  the  second  example  would  be  about  the  same  as  "He  was  astounded." 

It  is  not  always  easy,  however,  to  tell  when  a metaphor  is  dead,  and  I 
think  we  shout  a be  careful  not  to  throw  away  too  much.  Consider  the  situation 
of  prepositions.  For  the  purposes  of  chapter  4,  the  basis  for  associating  a 
preposition  with  ; arb  or  an  adjective  was  treated  as  arbitrary.  If  one 
looks  deep  enough,  houever,  there  is  often  a compelling  reason  for  the  choicq. 
Consider  the  example  "abh4i.y3n  von.”  Ue  would  translate  this  as  "depend  on," 
but  the  literal  meaning  is  "hang  down  from."  Here,  dependence  is  formulated 
in  terms  of  a physical  situation.  If  ue  hang  X from  Y and  then,  say,  move  Y, 
this  will  have  an  effect  on  X.  Note  that  the  English  "depend  on"  uses  a 
similar  physical  analogy,  but  it  is  a slightly  different  one,  that  of  support! 
If  X is  set  on  Y,  then  a motion  in  Y will  effect  X as  usl!.  (The  Latin 
ancestor  of  depend  - deoendere  - shares  the  hang-down-from  analogy,  but  that 
is  irrelevant  here.)  One  could  argue  that  the  spatial  analogies  here  represent 
dead  metaphors,  and  that  hanging  things  down  and  piling  things  up  have  no  real 
connection  tu  our  thoughts  about  dependence.  The  mor  closely  one  etudiee 
prepositional  use  in  both  German  and  English,  however,  the  more  epatial 
analogies  can  be  found.  This  situation  seems  to  be  especially  interesting  in 
the  light  of  Minsky’s  suggestion  that  a single  mechanism  could  account  for 
both  visual  and  conceptual  processing  (?7).  Prepositions  seem  to  be  one  more 
example  of  the  intimate  relationship  between  visual  and  conceptual  processes. 
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5.9  By-pasting  the  Deductive  Component 

The  iepieeentation  uses  an  ex  tress  I y simple  mechanism  to  by-pass 
understanding.  It  is  described  here  for  completeness  only,  since  it  will  be 
obvious  that  such  a scheme  would  be  Impractical  In  a working  eystem.  The 
program  requires  that  the  user  understand  the  text  and  eupply  the  information 
that  would  ordinarily  be  supplied  by  a deductive  component.  By  the  time  a I i 
this  interaction  has  taken  place,  the  user  could  have  long-eince  translated 
the  text  by  hand.  Nevertheless,  the  deductive  by-pass  routine  does  allow  us 
to  get  an  idea  of  how  the  system  would  behave  if  it  were  more  complete. 

After  the  semantic  component  hae  produced  the  possible  repreeent&t Ions 
the  user  is  asked  to  decide  which  representation  he  would  like  to  send  to  the 
generator  (by  typing  in  a number),  or  whether  he  would  like  to  see  the 
generator  try  Its  hand  at  ail  the  poeeible  representations  in  succession  (by 
responding  ALL).  For  each  representation  that  is  to  be  generated,  the  user 
ie  then  asked  to  supply  concept  markers  for  the  nodes  with  flUNSPEC.  Finally, 
nodee  for  noun  groups  marked  GIVEN  and  PARTICULAR  are  presented,  and  the  user 
le  asked  to  epeclfy  other  nodes  that  are  coreferent.  The  other  Information 
mentioned  in  eection  5.6  ie  not  requested  right  now,  since  the  generator  le 
not  fine-tuned  enough  to  uee  It. 


139 


Chapter  6 --  Generation 

6.1  The  Prcceee  of  Surface  Generation 
6.1.1  Input  to  the  Generator 

Having  completed  eyntactic  and  eeaantic  analysis  of  an  input  eentence,  ue 
are  now  at  the  point  where  generation  of  an  Engiieh  eentence  can  begin.  Th3 
firet  queetion  ie  juet  what  the  eurface  generator  ehouid  have  ae  ite  input, 
and  in  genera)  the  ansuer  to  thie  ie  not  difficuitt  ue  uant  to  uork  uith  the 
eeaantic  repreeentation  that  hae  been  conetructed.  In  deeigning  tha  eeaantic 
representation,  every  effort  uae  aade  to  Include  as  auch  inforaation  at 
poseibie,  uith  the  hope  that  thie  uouid  be  sufficient  for  the  generating 
process.  As  uiii  be  dlscuesed  below,  the  ser»ntic  repreeentation  ie  in  fact 
not  adequate  for  every  eventuality,  but  it  still  constitutes  the  aajor  input 
to  the  generator. 

One  couid  queetion  uhether  the  eeaantic  representation  ie  the  proper 
input  for  generation.  For  exaapie,  uhen  translating  written  Geraan  into 
English,  I find  ayseif  using  eyntactic  guidance.  One  look  at  a prenoainai 
clause  like  "die  unter  der  Haut  li  egenden  Ze  i i en"  (literally,  "the  under  the 
skin  lying  ceiie")  and  "relative  clause"  or  "that"  coaes  to  aind.  Thie  use  of 
language-dependent  trareiating  ruiee  or  heuristics  aay  be  a personal 
idiosyncracy,  or  it  aay,  in  fact,  be  one  of  the  shortcuts  that  people  often 
use  uhen  translating.  At  any  rate,  ruiee  depending  on  the  relation  of  eource 
to  target  language  uere  not  used  in  the  translating  eye  tea.  There  seeaed  to 
be  no  case  where  this  uae  necessary,  since  it  uae  always  possible  to  forauiate 
semantic  rules  corresponding  to  language-dependent  eyntactic  once. 
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6.1.2  Comparing  Generators  and  Interpreters 

The  surface  generator  was  written  In  an  extended  vereion  of  PROGRAMHAR, 
and  in  many  ways  it  ie  e i mi  I ar  to  the  interpreter.  Since  the  interpreter  and 
generator  were  built  for  two  different  natural  languages,  we  would  not  expect 
them  to  be  identical  on  a I ine-for-l  ins  baeis.  I would  argue,  however,  that 
even  if  only  a eingle  language  were  involved  here,  we  would  not  expect  the 
generator  to  oe  a I ine-for-l  ins  inverse  of  the  Interpreter.  Thle  le  because 
there  are  different  knowns  and  unknowns  for  the  two  proceeeee.  In  the  end, 
both  the  interpreter  and  the  generator  will  have  made  analogous  choices,  eince 
both  will  be  using  linguistic  intonation  based  on  a syetealc  characterization 
of  the  languages  involved.  But  different  information  will  be  available  at 
different  timee  for  the  two  processes.  An  interpreter  may  have  to  delay 
several  processing  stepe  until  a local  ambiguity  can  be  resolved  (or, 
alternatively,  it  may  try  one  of  the  poeeibi  I i ties  and  backup).  A generator, 
on  the  other  hand,  doee  not  necessarily  have  to  concern  itself  with  the  ieeue 
of  ambiguity  at  oil,  eince  all  of  the  information  it  needs  ie  available  in 
unambiguous  fora  from  the  semantic  representation.  (Here,  I am  using  local 
ambiguity  to  mean  ambiguity  that  will  be  resolved  by  the  time  a parser  hae 
finished  syntactic  analysis  of  a sentence;  see  Hill  (19))  In  addition,  while 
the  choices  made  for  generating  and  interpreting  are  comparable,  the  relative 
importance  of  the  choices  will  differ.  The  interpreter  uses  its  knowledge  of 
grammatical  redundancy  and,  '.n  its  better  moments,  semantic  likelihood  to 
decide  which  choice  was  made  by  the  author  of  an  utterance.  The  generator,  on 
the  other  hand,  has  a characterization  of  the  meaning  intended.  It  muet  make 
choices  to  communicate  its  message  effectively  and,  with  luck,  gracefully  and 
unambiguously.  Ue  can  therefore  expect  the  two  proceeeee  to  differ  in 
relative  timing  and  emphasis. 
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6.1.3  Translation  and  General-Purpose  Generation 

Several  times  already  1 have  referred  to  the  generating  component  ae  a 
“surface*  generator,  and  1 should  perhaps  clarify  what  1 Mean  iy  this.  In 
particular,  how  does  the  generation  procees  envleloned  here  coapare  to  the 
general  procees  of  writing  text  in  one's  oun  language?  The  big  difference  is 
that  the  generator  in  the  translating  eystee  le  starting  fro*  a highly 
specified  semantic  representation  which  ie  In  Best  cases  (I  will  dlscues  the 
exceptions  later  on)  unchanged  by  the  generator.  Ohviouely,  a lot  of  “deep" 
organization  has  already  been  done  by  the  ties  such  a seeantic  representation 
can  be  produced.  To  write  the  original  paragraph,  for  exaeple,  the 
inforeation  had  to  be  aeseebled  and,  If  it  wae  low-level,  aggregated. 

Patterne  of  reasoning  and  arguaent  had  to  be  choeen,  and  decisions  about  the 
relative  iaportance  of  different  inforeation  had  to  be  Bade.  Moreover,  these 
steps  are  not  necessarily  Independent,  but  Bay  be  linked  In  rather  coapl  Seated 
ways.  The  surface  generator  in  the  translating  eystea  does  not,  in  Boat 
cases,  have  to  consider  these  choices,  since  they  are  already  specified  in  the 
eeaantic  representation.  In  this  sense,  then,  generation  for  translation  ia 
easier  than  its  Bore  general-purpose  counterpart. 

I should  note  that  in  characterizing  generation  for  translation  ae 
genera  I -pur  poee  generation  ainue  eoae  “deep"  etepe,  I do  not  wish  to  suggest 
that  the  eeaantic  representation  used  here  neceeearily  represents  an 
intermediate  level  in  the  general  generation  process.  In  fact,  I suspect  that 
in  a general-purpose  generator,  we  would  not  want  to  create  euch  a highly 
organized  eeaantic  repreeentation  while  coapletely  ignoring  the  lexical  and 
graaaatical  level  of  the  target  language.  It  would  not  eurprlse  ae,  then,  to 
see  eubetantial  differences  between  the  organization  of  a general-purpose 
generator  and  tha  generator  described  here. 
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!n  addition  to  these  differences,  Me  can  say  that  If  generation  for 
translation  can  ba  considered  easier  than  general-purpose  generation.  In 
another  uay  it  is  harder.  The  generator  does  not  have  to  decide  uhat  to  say, 
but  the  other  half  of  the  coin  is  that  it  has  to  tailor  uhat  is  generated  to 
the  intent  of  the  original  text.  And  this  text,  of  course,  uas  uritten  in  a 
different  language.  If  ue  can  say  that  languages  are  organized  to  convey 
meaning,  ue  can  also  say  that  the  organization  of  particular  Messages  is 
influenced  by  the  facilities  available  in  a given  language.  Word  choice  ie  an 
obvious  example  here  - there  is  often  not  an  exactly  equivalent  uord  in  +he 
target  language.  But  the  problem  actually  mwnifeets  itself  at  all  levels  of 
linguistic  organization.  Uhen  a mismatch  between  languages  occurs,  ue  often 
have  to  compromise,  suspending  one  goal  to  achieve  another.  It  is  true  that 
similar  compromises  must  also  be  maoe  in  general-purpose  generation, 
especially  in  a situation  where  one  is  particularly  concerned  about  style. 

(The  uorst  case  here  ie  translating  poetry.)  The  need  for  such  compromise  is 
much  more  frequent  in  translation,  however,  and  occurs  even  in  cases  uhere 
style  is  relatively  unimportant. 


6.2  The  Engl i eh  Grammar 

6.2.1  The  Basic  Shape  of  the  Generating  Grammar 

The  English  generator  has  three  main  parts.  There  is  a group  of  English 
syntactic  specialists  for  clauses,  noun  groups,  preposition  groups,  and 
adjective  groups,  in  addition,  a set  of  routines  exists  to  build,  maintain, 
and  inspect  a "generation  tree,"  which  records  the  progress  o’  the  generating 
process  to  oate.  Finally,  there  are  definition  programs  associated  uith  the 
concept  markers.  Only  two  standard  definition  programs  are  used,  but  we  shall 
see  that  they  offer  a great  deal  of  latitude  in  the  form  a definition  may 
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take.  The  generator  translates  a single  sentence  at  a tiee,  although  there  ie 
nothing  to  stop  it  froe  using  information  about  the  context  of  a eentence,  or 
from  inspecting  the  text  that  has  already  been  generated. 

Before  going  on,  I should  make  a feu  remarks  on  the  scope  of  the 
generator.  The  system  has  only  a feu  English  dictionary  definitlone  at  this 
point,  but  the  routines  for  uriting  definitions  are  quite  general.  The 
English  syntactic  specialists  are  not  as  extensive  as  their  German 
interpretive  counterparts.  The  reason  for  this  uas  basically  one  of  time,  and 
extending  the  breadth  of  the  generating  routines  would  be  a straightforuard 
process.  This  is  clear  first  because  the  existing  programs  can  generate 
moderately  complex  sentences:  subordinate  clauses,  conjoined  structures,  and 

rankshifted  noun  groups.  Second,  the  major  gaps  in  the  English  generator, 
most  notably  that  it  does  not  deal  uith  questions  or  commands,  can  be  plugged 
uith  code  that  uill  look  very  much  like  the  declarative  code  that  has  been 
uritten.  Declarative,  Interrogative,  and  imperative  pathe  through  the 
generator  should  share  a lot  of  cotimon  code,  as  they  do  in  the  German 
interpretive  grammar.  In  contrast  to  extending  the  breadth  of  the  generator, 
extending  its  depth,  i.e.  giving  it  the  ability  to  make  more  Informed 
choices,  is  of  course  a more  difficult  task.  The  syntactic  types  that  uere 
implemented,  houever,  pose  enough  questions  for  a start,  eince  in  language 
there  are  no  truly  "simple''  examples.  Finally,  the  routines  for  generation 
tree  construction  are  fully  implemented,  and  they  are  the  subject  of  the  next 
section. 

6.2.2  Additions  to  PROGRAfflAR 

The  first  etep  in  building  the  English  component  uas  to  make  tuo  additions 
to  PRGGRAPIflAR.  A mechanism  uas  necessary  for  building  and  maintaining  a 


generation  tree,  and  special  functions  were  needed  to  specify  the  nodes  to  be 
added  to  the  tree.  The  first  task  was  a relatively  staple  one  - generation 
tree  nodes  are  defined  as  carrying  the  following  Informations 
FEATURES 

The  syntactic  features  of  the  unit 
ROOT 

If  the  node  is  a terminal  one,  the  root  of  the  word 

translated 

PHRASE 

The  phrase  generated  for  the  unit 
OAUGHTERS 

The  daughters  of  the  node  in  reverse  order 
SEMANTICS 

The  semantic  node  for  which  the  unit  uas  generated 
The  information  at  a node  may  be  read  using  the  functions  FE-E,  PH-E,  H-E,  and 
SM-E  with  the  node  as  argument.  Here,  the  ”E''  stands  for  English  and  It  used 
to  maintain  the  distinction  between  this  generation  tree  and  the  German  parse 
trea.  Global  variables  analogous  to  thoss  for  ths  parse  tree  are  maintained! 
C-E,  H-E,  etc.,  with  the  obvious  meanings.  The  message  variable  mechanism  is 
the  same,  and  so,  with  some  added  code,  are  the  backup  functions  POP  and 
POPTO. 

A node  ie  added  to  the  generation  tree  much  as  in  parsing,  and  the  basic 
function  for  this  is  TRANSL.  Uhen  TRANSL  is  called  a node  is  set  up,  and  if 
TRANSL  succeeds,  the  node  is  added  to  the  tree.  Just  as  with  PARSE,  a call  to 
TRANSL  may  specify  the  name  of  a clause  or  group,  or  the  call  may  request  a 
lexical  unit  like  NOUN  or  ADJ.  Unlike  PARSE,  the  call  to  TRANSL  also  contains 
the  name  of  a node  In  the  semantic  representation  for  which  the  generatlon  le 
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to  be  done.  Aieo  unlike  the  parse  tree,  the  daughters  of  a node  on  the 
generation  tree  do  not  have  to  be  accueuiated  in  order.  It  ie  poeeibie  to 
specify  that  a node  be  attached  anywhere  in  the  list  of  daughters  of  the 
currently  active  node.  A caii  to  TRANSL  uith  a clause  or  group  naee  causes  • 
call  to  the  corresponding  English  generating  specialist,  and  ita  euccese  or 
failure  determines  the  success  or  failure  of  TRANSL.  If  TRANSL  io  called  to 
generate  a single  word,  it  executes  a procedure  associated  with  the  concept 
marker  of  the  OSS,  RSS,  or  PSS  to  be  translated.  These  individual  procedures 
will  be  discussed  More  fully  below. 

The  generating  routines  invoked  by  TRANSL  to  generate  groups  look  very 
Much  like  their  interpretive  counterparts.  The  basic  etateaent  type  ie  etill 
the  PROGRAMMAR  branch  function  "t",  although  tinted  to  a two-way  branch, 
eince  it  is  not  clear  how  the  three-way  branch  should  be  defined  fcr 
generation.  The  inspection  functions  like  CQ-E  and  HQ-E  are  analogoue  to 
those  in  PARSE,  as  are  F-E,  FQ-E,  and  related  functions  that  add  information 
to  a node.  At  the  outset,  it  is  not  completely  clear  that  it  is  necessary  to 
construct  a generation  tree,  but  holding  on  to  syntactic  information  like  the 
location  of  an  adjective  or  object  of  a preposition  allows  the  grammar  to  make 
decisions  based  on  the  structure  of  the  generated  sentence  at  that  point.  A 
tree  also  permits  easy  incorporation  of  backup  should  the  generation  process 
run  into  difficulty. 

6.2.3  The  Generating  Process 

Where  the  interpreter  moved  Seft  to  right  over  a sentence,  the  generator 
moves  basicaiiy  top-down  through  the  semantic  representation.  That  ie,  the 
generator  moves  top-down  through  the  LINKAGE  registers,  and  at  each  stage, 
after  participants  have  been  translated,  it  sequences  through  the  MODIFIERS 
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llnke.  An  example  Might  be  the  eaeieet  way  to  explain  the  traneltione 
Involved.  Figure  5.1  ehoue  the  eeaantlc  representation  for: 

Oer  Cephalopod  beeftzt  gelbe  Chromatophoren.  The  cephalopod  has  yellow 
chroaatophores. 

At  the  top  level  the  generator  calls  ITRANSL  CLAUSE  MAJOR  TOPLEVEL  SMNOOE: 

RSS1)  which  in  turn  calls  the  syntactic  specialist  CLAUSE-E.  Since  these  *-E’ 
tags  are  no  doubt  distracting,  I will  Ignore  the*  froa  here  on.  Any  routine 
Mentioned  in  this  chapter  ie  part  of  the  English  coaponent  unless  otherwise 
noted.  The  Main  relation  (here,  RSS1)  Is  always  the  topMost  link  In  the 
seeantic  representation,  so  It  is  specified  In  the  clause  call.  The  first 
decision  in  CLAUSE  ie  whether  to  generate  an  interrogative,  Imperative,  or  a 
declarative  clause,  and  the  CLAUSE-TYPE  register  of  the  Main  relation  ie 
checked  for  its  recoaaendation.  Since  here  the  clause  type  ie  "statement," 
the  generator  follows  the  declarative  path,  placing  the  tag  DECLARATIVE  in  the 
current  node  C.  The  tag  TOPLEVEL  Indicates  that  the  node  generated  will  not 
have  a parent  on  the  tree.  Next,  CLAUSE  calls  the  phrase  routine  VERB-PHRASE 
and  which  Makes  the  call  (TRANSL  VERB  F1VB  SMNOOE:  RSS1).  Note  that  in 
English,  as  in  German,  we  will  follow  Hudson  and  speak  of  a verb  phrase 
instead  of  a verb  group.  The  generator  translates  the  main  verb  first,  since 
It  is  the  key  to  the  ordering  of  the  other  constituents  in  the  clause.  A call 
of  TRANSL  with  MYB  will  return  the  verb  node  and  also  returns  a participants 
list  with  the  grammatical  structures  that  the  verb  expects  for  Its 
participants.  The  list  has  been  ordered,  taking  Into  account  the  objects 
required  by  the  verb  chosen,  the  theMe  of  the  sentence,  and  whether  the  verb 
ie  grammatically  passive  or  active.  VERB-PHRASE  should  also  go  on  to  generate 
any  auxiliary  verbs  and  supervise  tenses,  but  only  the  simplest  active  and 
passive  constructions  are  handled  right  now. 
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The  participante  i!et  returned  by  the  Rain  verb  it  in  the  fora  of  a 
eeries  of  calls,  and  the  clause  routine  need  only  execute  it.  CLAUSE  doee  eo 
now  and  ca list 

(TRANSL  NG  FULL  NOfl  BEFORE*  <verb  node>  SMNOOEt  0SS1) 

The  BEFORE  here  Indicates  that  this  noun  group,  since  it  will  be  the  subject, 
should  precede  the  verb  node  just  generated.  The  feature  NOH  indicates 
nominative;  other  Englieh  syntactic  cases  ueed  are  OBJective  and  POSSessive. 
FULL,  as  in  chapter  2,  means  that  a rankshifted  noun  group  may  be  generated  If 
neceesary.  In  translating  the  noun  group,  the  routine  NG  first  consults  the 
COREF-  register  to  find  the  reference  if  any.  This  is  because  a word  choice 
mil  often  depend  on  the  uord  choice  made  for  its  corefferent.  From  here  NG 
caile  (TRANSL  NOUN  SHNOOEr  0SS1).  It  is  clear  that  it  makee  sense  to 
translate  the  noun  in  a noun  group  first,  since  its  choice  uiil  tend  t" 
influence  uord  choice  in  the  modifiers.  This  is  most  obviously  true  for 
compounds,  uhich  may  absorb  some  of  tha  modifiers.  For  any  sort  of  noun, 
since  ue  do  not  have  a one-to-one  mapping  between  words  and  concepts,  the 
generator  may  have  to  do  some  shuffling  to  find  a good  match  betueen  noun  and 
modifiers.  It  serins  most  natural  to  express  these  requirements  in  terme  of 
the  noun  to  be  modified.  At  any  rats,  once  the  noun  has  been  tranelated,  NG 
goes  on  to  translate  modifiers  into  the  appropriate  pre-  and  post-nominal 
structures,  ueing  rules  based  on  semantic  case  to  do  the  ordering.  Our 
example  "der  Cephaiopod"  hae  oniy  a determiner,  uhich  is  generated  from 
relations  with  case  SELECTION  and  NUMBER,  taking  the  category  given-neu  into 
consideration.  Since  no  relations  remain,  TRANSL  can  cU lect  its  results, 

"the  cephaiopod,"  in  the  noun  group  node  under  PHRASE.  Both  the  subject  and 
the  verb  have  been  generated,  eo  TRANSL  can  cali  the  routine  AGREE.  AGREE 
makee  morphological  changes  to  the  verb  root  so  that  it  will  agree  with  the 
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subject  in  person  and  number.  Note  that  in  English,  agreement  is  much  lees 
complex  than  in  German  and  that  AGHEE  has  a much  easier  time  than  i to 
interpretive  counterpart  INPUT,  since  it  does  not  have  to  go  eearching  for  an 
unknown  root. 

CLAUSE  is  now  ready  to  generate  the  next  entry  in  the  verb  node’e 
chopping  list,  and  it  turns  out  that  we  want  the  direct  object.  The  example 
finishes  up  as  CLAUSE  makes  a second  call  to  NG  with  (TRANSL  NG  FULL  OBJ 
SMNOUE;  0SS2).  NG  will  generate  the  main  noun  from  0SS2,  then  take  care  of 
the  determiner,  and  finally  call  (TRANSL  ADX  BEFOREi  <noun  node>  SHNGOEt 
RSS4)  to  generate  the  adjective  uel  low.  Uhen  the  direct  object  NG  call  hae 
returned,  the  generator  gathers  up  the  results  from  the  PHRASE  entriee  of  the 
conet i tuents,  makes  a PHRASE  entry  in  the  clause  node,  decides  on  punctuation, 
and  returns  from  CLAUSE. 

This  was  obviously  a relatively  simple  example,  and  the  generating 
grammar  can  handle  more  complex  cases.  Before  further  discueeion,  however,  it 
might,  be  a good  idea  to  take  a look  at  the  mechanism  for  word  choice. 

6.3  Translation  at  the  Lexical  Level 
6.3.1  The  English  Definition  Routines 

Uhen  TRANSL  is  called  to  construct  a terminal  node  in  the  generation 
tree,  it  looks  up  the  concept  marxer  associated  with  the  semantic  node  under 
coneideration  and  then  retrieves  an  English  definition  routine  from  the 
concept.  The  defirition  routines  are  roughly  analogous  to  the  eemantic 
specialist  routines  in  the  interpreter.  Uhere  the  eemantic  epecialiets 
inspect  the  parse  tree  in  order  to  build  a semantic  reoresentat ion,  the 
English  definition  routines  start  from  the  semantic  representation  and  uee 
special  information  to  not  only  supply  a node  for  the  generation  tree  (and 


hence  a translation)  but  also  to  soscify  other  nodes  that  ui  i i be  required  if 
this  translation  is  to  be  used.  The  syntactic  shopping  list  supplied  by 
definition  routines  uhen  a relation  is  translated  is  analogous  to  the  global 
variables  bound  by  the  interpretive  eenantlc  special  ate  to  supply  arguments 
to  relations  in  the  semantic  representation. 

There  are  tuo  standard  dictionary  routines,  TRANSL-REL,  for  translating 
semantic  relations,  and  TRANSL-OBJ-PROP,  for  translating  objects  and 
properties.  The  tuo  routines  are  quite  similar,  except  that  more  information 
must  be  supplied  to  translate  relations.  It  would  probably  be  helpful  at  thle 
point  to  list  the  information  that  can  appear  in  a definition.  Starred  iteme 
appear  only  in  definitions  for  relations,  uhile  the  rest  may  be  used  for  all 
three  classes. 

ORDER*  LEXACT  or  LEXPASS 

TYPE*  NONE,  ONE,  TUO,  etc.  This  specifies  the  entries  in  the 
relation’s  linkage  register  that  may  be  left  understood. 

ROOT  the  root  of  the  translation 

FEATURES:  the  part  of  speech  of  the  translation  and  then  a list  of 

other  features,  uhich  are  not  nou  required  to  match  those  in  the  TRANSL 
cai  i 

UORO:  specified  for  irregular  forms  only 

PARTICIPANTS:*  a variable  name  or  email  procedure  that  epecifiee  the 
participants  list 

CONNOTATIONS:  currently  oniy  one  feature  and  optional 

PROBABILITY:  number  from  1 to  10 

CONDITION:  a procedure  that  must  evaluate  to  non-nii  if  this 

definition  is  to  be  used. 

COLLOCATIONS:  a list  of  parts  of  speech  and  root  of  uords  required. 

This  is  currently  used  oniy  for  prepositions  and  particles. 

PROCEDURE:  a procedure  that  is  executed  if  this  definition  is  selected. 

It  allous  a concept  to  be  translated  by  more  than  one  uord  and  does  other 
useful  things. 
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A call  to  a definition  routine  Mould  have  as  its  parameter  e liet  of  poeelble 
definitions,  each  expressed  l.i  terms  of  these  keywords  and  their  values.  The 
possible  definitions  first  go  through  w ^eliminary  round  nf  elimination  baeed 
on  the  part  'f  speech  required  in  the  TRANSL  call  (matched  agalnet  FEATURES), 
a match  on  connotations  (If  CONNOTATIONS  is  set  in  the  definition  liet,  it 
must  match  the  connotations  In  the  semantic  node.)  and  an  evaluation  of  the 
CONDITION  procedure,  if  there  is  one.  In  traiis!.  ing  relations,  definitions 
are  also  screened  fo-  ORDER  (LEXPASS  or  LEXACT)  and  TYPE  (NONE,  ONE,  TUO, 
etc.)  agreement,  which  were  discussed  in  section  4.2.1.  After  the  preliminary 
screening,  a definition  with  the  higheat  probability  ie  picked,  nr,  if  there 
are  severe  definitions  with  this  probability,  the  first  one  encountered  ie 
used.  In  the  English  dictionary,  the  probabilities  are  expressed  as  numbers 
from  1 to  16,  and  reflect  a rough  estimate  of  the  order  in  uhich  the  uorde 
should  be  tried.  Probabilities  could  no  doubt  be  better  expreesed  ae  small 
procedures  thot  check  context  and  return  an  appropriate  estimate,  but  no 
refinements  have  been  made  in  this  direction.  Once  a word  has  been  selected, 
its  features  are  added  to  the  feature  list  of  the  node.  Other  definition 
lists  that  passed  the  preliminary  screening  are  placed  in  the  LEXALTLIST 
register  (lexical  alternative  list)  on  the  node  <n  case  backup  is  necessary 
later  on.  If  ue  are  translating  a relation,  its  participants  shopping  list  Ie 
also  attached  to  tne  node.  Finally,  the  root  of  the  English  word  ie  returned 
to  TRANSL.  uhich  finis’ies  building  the  node,  calling  morphology  routines  to 
au u the  necessary  endings  for  the  individual  uord. 

6.3.2  One  Darker,  Several  Uorde 

The  last  section  presented  the  simplest  case,  uhere  a concept  marker  ie 
translated  by  a single  word.  The  definition  routines  must  also  be  able  to 
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handle  the  case  in  which  one  Marker  bscoMes  several  words,  and  the  case  where 
several  interrelated  Markers  become  ore  word.  For  situation  one,  eeverai 
Mechanisms  are  available.  If  the  marker  is  a relation,  the  COLLOCATIONS  Met 
in  used  for  prepositions  and  particles  required  by  verbs,  adjectivee,  etc. 

The  definition  procedures  access  this  list,  and  insert  the  required  word  in 
the  correct  place  in  the  participants  shopping  list.  For  more  complicated 
constructions,  PROCEDURE  is  used.  Assume,  for  the  sake  of  example,  that  the 
conceptual  etructure  contained  the  marker  0BEFR1ENO,  jnd  we  wanted  to 
translate  the  English  as  "make  friends  with.”  One  way  to  do  this  in  the  eyetem 
is  with  a definition  of  the  forms 


0BEFRIENO 

(TRANSL-REL  ((LEXACT  NONE  make 
FEATURES:  (VERB  IIVBI 
COLLOCATIONS:  ((PREP  with)) 

PARTICIPANTS:  PREPOBJ-INTRANSA 
PROCEDURE: 

(TRANSL  NG  NOOET  PLUR  OBJ 
GROUP:  ((TRANSL  NOUN  PLUR  COmCN 

UORO:  friends 
ROOT:  friend)) 

SftNOOE:  oemantic  nods  of  the  seccnd  argument  of 
#BEFRIEN0>) 


Here,  LEXACT  means  that  the  order  of  the  arguments  of  the  verb  corresponds  to 
the  order  of  the  arguments  of  the  concept  marker.  NONE  means  that  no  marker 
arguments  have  been  left  understood,  and  make  is  the  root  of  the  main  verb. 
Uhere  a phrase  is  produced  by  a definition,  the  word  in  the  ROOT  position 
corresponds  to  tie  part  of  speech  TRANSL  would  be  iooking  fori  in  this  case, 
the  call  would  have  been  (TRANSl  VERB  MVB).  Here,  PARTICIPANTS  le  eet  to  a 
variable  whose  value  i**  the  system  is  a series  of  caiis.  The  PARTICIPANTS 
would  be: 


tie  it'Tffnrt  I 
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(SETQ  PREPOBJ-INTRANSA  ’((TRANSL  NG 
FULL 
NOH 

SmCOEi  (CAR  ARGSLIST) 
BEFORE:  <first  verb>) 


(TRANSL  PREPG 

SHNOOE:  (CAOR  ARGSLIST) 

GROUP: 

((PREP  UORO:  XREQUIREO-PREPX 

ROOT:  XREQU1REO-PREPX) 

(NG  SinPLE  OBJ)))))) 


ARGSLIST  Is  an  ordered  list  of  arguments  of  the  RSS  to  be  translated.  The 
definition  procedure  will  set  up  a register  to  el  low  wi  th  to  be  eubetituted 
for  XREQUIREO-PREPt  when  the  preposition  is  generated.  Note  that  here  and  in 
PROCEDURE,  ue  see  a special  sort  of  call  to  TRANSL.  Uhen  ROOT  le  specified  in 
a TRANSL  call  along  uith  a part  of  apeech,  the  definition  routines  are  by- 
paesed,  and  the  node  usee  the  FEATURES,  ROOT,  and,  if  given,  the  UORO  eupplied 
in  the  call.  Similarly,  If  a group  or  clause  is  to  be  translated,  ttv*n  the 
keyword  GROUP  can  be  used,  followed  by  a list  of  TRANSL  cal  le  and  other 
functions.  The  GROUP  feature  makes  it  possible  to  by-pass  syntactic 
specialists.  Note  that  ue  do  not  have  to  fully  specify  the  words  in  a group 
uhen  using  these  features,  for  example  the  preposition  group  from  the 
participants  list  above: 

(TRANSL  PREPG  GROUP: 

((TRANSL  PREP  ROOT:  XREQUIREO-PREPX 
UORO:  XREQU I RED-PREP* ) 

(TRANSL  NG  SIHPLE  OBJ)) 

SHN00E:  <eemantlc  node  of  second  argument  of 
#BEFHlEN0>) 


This  call  says,  "Translate  a preposition  group,  looking  up  the  required 
preposition  and  using  the  second  argument  of  ABEFRIEND  to  produce  a noun 
group."  This  ability  to  by-pass  definition  routines  and  syntactic  specialists 
ie  extremely  useful,  and  allous  us  to  urlte  efficient  definitions  in  a 
relatively  economical  manner.  The  one  drawback  might  be  the  number  of 
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features  that  must  be  specified  along  with  the  words,  but  it  Mould  be 
relatively  easy  to  incorporate  a prompting  facility  to  aid  in  definition 
writing,  and  to  package  the  eost  coemon  types  of  PROCEDURE  in  the  eaae  way 
that  the  participants  lists  have  been  packaged.  Ten  or  fifteen  standard 
patterns  Mould  probably  handle  a good  percentage  of  the  different  Muiti-word 
situations  that  coas  up. 

6.3.3  Several  Markers,  One  Uord 

The  case  just  discussed  involved  one  concept  Marker  going  to  several 
words.  Let  us  now  take  a look  at  case  two,  where  several  interrelated  concept 
Markers  go  to  a single  uord.  This  is  dons  using  a coebi nation  of  the 
CONDITION  and  PROCEDURE  keywords.  CONDITION  is  used  to  specify  a piece  of 
seaantic  representation  that  Must  Match  the  seeantic  representation  of  the 


Figure  6.2 

sentence,  and  then  PROCEDURE  is  used  to  tell  the  rest  of  the  generator  how 


155 


Much  of  the  semantic  representation  hae  been  absorbed  by  the  particular  word. 
An  example  of  a multi-marker  to  single  uord  tranelation  ie  the  generation  of 
the  adjective  visible  from  the  repreeentation  ehoun  in  Figure  6.2.  Here,  the 
fctar  indicates  that  any  semantic  node  may  be  In  this  poeition.  Among  other 
information,  the  tranelation  routine  uould  contain: 

(/SEE 

visible 

CONDITION: 

(MATCH  (FIND-LINK:  /(PERSON) 

(MOOIFIER:  (/HAVE -PROPERTY  (/SELECTION) 

(LINKS:  (/PERSON  (/ANY) 

SM-E 

(MOOIFIER:  (/ABLE) 

(LINKS:  (/PERSON  (/SEE)) 

PROCEDURE: 

(REMOVE  (/ABLE  (/GENERAL  NOOIFIERS) 

Uhen  CONDITION  is  executed,  the  routine  MATCH  starte  at  the  place  in  the 
semantic  representation  currently  being  coneidered  by  the  generator,  in  thie 
case  the  RSS  for  (/SEE.  The  MATCH  routine  movee  through  the  MODIFIERS  and 
LINKAGE  paths  specified,  comparing  concept  markers  against  the  arguments 
given.  If  a concept  mar  '»■>•  alone  is  not  enough  to  distinguish  a modifier,  the 
case  may  be  supplied,  as  is  done  for  the  (/HAVE-PROPERTY  relation  above. 

LINKS,  MOOIFIER  and  F IhTO— LI NK  aluaye  refer  to  the  argumente  of  the  relation 
examined  just  previously.  To  change  the  focus  of  attention,  MATCH  may  be 
given  a eemantic  node,  ae  ua<i  done  above.  MATCH  ie  currently  limited  In  the 
kinds  of  comparisons  that  can  be  made,  for  example  it  is  not  nou  possible  to 
specify  that  tuo  uses  of  the  same  concept  marker  should  refer  to  different 
variables.  Such  extensions,  houever,  uould  be  etraightforuard.  The  matching 
process  is  not  a particularly  expensive  one,  since  the  ordering  of  the 
representation  ie  aluaye  fixed,  and  ue  knou  uhich  nodes  are  to  be  heads  and 
uhich  modifiers.  Note  that  MATCH  is  rot  the  only  eort  of  routine  that  may  be 
used  as  a condition.  CONDITION  succeeds  or  fails  depending  on  uhether  its 
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associated  procedure  succeeds  or  fails. 

Once  the  condition  has  been  satisfied  and  the  definition  is  chosen, 
PROCEDURE  is  executed  to  tell  the  generator  not  to  try  to  translate  the 
Modifier  0ABLE  (uhere  the  case  here  is  given  as  ^GENERAL),  since  this  has 
already  been  used.  The  only  point  worth  Mentioning  about  PROCEDURE  Is  that 
its  effects  Must  be  Dm! ted  to  the  node  currently  being  constructed  by  the 
TRANSL  call.  This  is  necessary  to  Keep  backup  simple,  since  when  a node  le 
popped  froM  the  tree,  ue  want  all  the  constraints  it  has  placed  on  the 
generation  process  to  disappear  with  it.  The  limi+ations  on  PROCEDURE  are 
currently  self-ittpoaed  by  the  dictionary  writer,  since  the  systeM  Makes  no 
checks  on  what  is  being  set. 

The  two  definition  methods  discussed  here  give  the  dictionary  routines  a 
great  deal  of  power.  The  Method  described  in  the  last  section  allows  the 
generator  to  translate  a single  Marker  into  classifier  plus  noun,  or  to  a 
whole  clause  if  it  is  desired!  the  Method  in  this  section  allows  the 
generator  to  handle  relation  participant  nouns  such  as  indication,  which  are 
defined  as  flSGflETHING  plus  a relation,  in  this  case  'souething  that 
indicates."  Ue  can  combine  the  two  Methods  to  translate  a piece  of  semantic 
representation  into  More  than  one  English  word,  which  should  be  useful  for 
idioeatic  phrases  like  "Strike  while  the  iron  is  hot."  Given  this  generality, 
the  wr  :ing  of  dictionary  routines  is  relatively  siMple,  and  it  will  become 
easier  when  More  standard  patterns  and  procedures  are  built  Into  the 
generator. 

6.4  Stumbling  Blocks  in  the  Generating  Process 

In  the  example  used  to  explain  the  generating  program,  the  generator  was 
suspiciously  successful  at  oach  translating  attempt.  This  is  not  always  the 
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cate,  and  eeveral  problea  situation*  Mill  be  discussed  here.  Tha  first  is  tha 
need  for  backup,  then  the  Issue  of  repetition,  and  the  problea  of  sentence 
length. 


6.4.1  Backup 

There  are  several  cases  in  which  backup  is  necessary.  The  Boat  obvious 
ie  the  case  of  lexical  gaps,  or  awkwardness,  in  the  target  language.  In 
general,  if  the  first  translation  atteapted  by  the  systea  does  not  succeed, 
the  generator  needs  a way  to  try  the  alternatives  In  an  orderly  Banner.  The 
Mechanise  supplied  to  handle  backup  in  the  generator  Is  a fairly  general  one, 
a I trough  I have  not  urittsn  enough  backup  cods  at  this  point  to  give  aore  then 
an  initial  report  on  its  perforaance.  The  reader  should  keep  in  aind  that  I 
aa  discussing  a facility  provided  to  allow  the  designer  to  incorporate  backup 
into  prograas,  not  a full-fisdged  backup  Mechanise. 

There  are  two  levels  in  the  generator  where  choices  are  aadei  at  the 
lexical  level  and  within  the  syntactic  specialists.  There  are  therefore  two 
sets  of  liets  that  are  Maintained  as  registers  on  nodes  for  backup  purposes! 
LEXALTLIST  (the  lexical  alternative  list)  and  ALTLIST  (the  structural 
alternative  list).  Uhen  a definition  is  evaluated  and  a word  ie  chosen,  other 
possible  definition  iists  that  passed  the  initial  screening  described  in 
section  6.3.1  are  placed  in  the  LEXALTLIST  of  the  node  being  created.  At  the 
etructural  level,  every  choice  that  eight  be  Independently  reversible  (i.e. 
would  not  imply  automatic  reversal  of  choices  made  earlier)  leaves  tracks  on 
the  ALTLIST.  These  tracks  consist  of  the  function  In  which  the  choice 
occurred  and  a statement  label  where  code  for  the  alternative  choices  begins. 

If  the  generator  runs  Into  difficulty  (I.e.  all  possible  TRANSL  calls  at 


a given  point  fail),  special  backup  routines  are  called,  in  general,  the 
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first  step  taken  Mill  be  to  trg  to  retranslate  the  relation  for  uhich  the 
problematic  semantic  node  is  a participant,  if  euch  a relation  exists. 
LEXALTLIST's  are  used  to  supply  these  neu  alternatives.  Backup  routines  do 
uhat  they  can  to  keep  other  participants  that  have  been  generated  intact,  that 
is,  to  find  lexical  alternatives  with  similar  participants  shopping  lists.  If 
no  lexical  changes  solve  the  problem,  a structural  change  ie  attempted.  For 
this,  ALTLIST  is  used,  and  an  attempt  is  made  to  reverse  the  most  recent 
choice  first.  The  offending  nodes  are  popped  from  the  tree,  and  control 
returns  to  the  routine  and  label  specified  by  ALTLIST.  The  syntactic 
specialists  are  structured  in  such  a way  that  business  uill  proceed  as  ueual 
after  a backup,  except  that  the  ALTLIST  has  been  reduced  by  one  poeeibility. 

For  the  limited  number  of  cases  attempted,  thie  backup  echeme  seems  to  be 
general  enough.  It  does  rest  on  the  assumption  that  structural  choices  can  be 
fully  order  uith  respect  to  each  other,  and  that  this  ordering  uill  not  vary 
from  one  eituation  to  another.  Only  more  experience  uith  the  generator  uill 
determine  uhether  this  assumption  allous  enough  generality  in  the  system. 

Before  going  on,  I uould  like  to  consider  the  use  of  backup  in  the 
context  of  generation.  It  may  be  that  further  research  uill  point  out  uays  to 
cut  doun  on  backup  by  deferring  some  decisions  to  later  in  the  process  or 
anticipating  others.  I do  think,  however,  that  backup  uill  remain  an 
important  facility  in  a generator.  Unlike  interpretation,  the  possible 
surface  structures  for  a given  semantic  representation  are  not  fixed.  There 
can  be  no  question  here  of  generating  "all”  the  possibilities  instead  of 
backing  up,  since  uith  a facility  for  paraphrase,  ue  could  no  doubt  go  on 
generating  possibilities  to  rather  ridiculous  extremes.  It  might  be  deeirable 
to  generate,  say,  the  three  most  likely  lexical  possibilities  at  any  given 
point.  This  probably  uould  not  cause  combinatoric  explosion,  since  possible 


159 


paths  uould  be  eliminated  quickly.  I do  no\  have  enough  experience  uith  the 
generator  to  judge  the  desirability  of  this  scheme.  But  no  matter  uhat  new 
mechanisms  are  introduced,  a backup  mechanism  uill  no  doubt  remain  an 
important  component  in  a text  generator. 

6.4.2  Repetitions 

The  phenomenon  of  repetition  is  an  sssentially  stylistic  problem;  that 
is,  meaning  is  not  affected  seriously.  Repetitions  can,  however,  be  extremely 
distracting.  For  example,  the  first  sentence  of  the  sample  paragraph  contains 
the  phrase  "sin  dsutlich  sichtbarss  Zeichen."  The  uord  list  for  sichtbar  here 
contains  visible,  perceptible,  and  evident!  for  deutlich  ine  list  is 
diet inct.  clear,  plain,  and  evident.  Nou  as  it  happens  vhis  is  translated  as 
"a  clearly  visible  indication,"  but  uhat  if  for  some  reason  the  generator  had 
chosen  evident  for  sichtbar?  Suppose  further  that  the  dictionary  only 
contained  one  translation  for  deut I ich  and  that  one  uas  evident.  An 
"evidently  evident  indication"  sounds  a little  like  Gilbert  and  Sullivan,  so 
the  AOX  routine  had  better  retranslate  deut1  ich  to  try  to  come  up  uith 
something  a little  less  repetitive. 

Not  all  repetitions  are  equally  annoying.  For  example,  three  the* e in  a 
sentence  uould  not  be  noticed  at  all,  uhile  three  however * s Mould  not  be 
overlooked.  In  addition,  some  repetition  of  clause  structure  is  desirable, 
e.g.  where  parallelism  is  used  as  a stylistic  device.  Finally,  differences  in 
function  tend  to  influence  judgments  about  uhat  is  repetitious. 

(i)  He  went  to  the  zoo  to  talk  to  the  elephant. 

(ii)  The  problem  uith  meeting  uith  the  Board 

is  that  Harry  non’ t come. 

Here,  the  tuo  ui  th*  s in  (ii)  seem  more  prominent  than  the  three  ifl*  e in  (I). 
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This  seems  to  be  because  the  second  1a  heads  an  adjunct  clause  rather  than  a 
preposition  group.  The  question  of  which  repetitions  are  repetitious,  then, 
is  not  as  straightforward  as  it  would  seen. 

In  considering  repetitions,  let  us  first  make  the  distinction  between 
structural  and  lexical  ones.  No  efforts  were  made  in  the  system  to  handle 
structural  problems  like  repetitious  clauss  types,  repetitious  use  of 
conjoined  structures,  and  other  relatively  high  level  phenomena.  Heuristics 
to  handle  these  sorts  of  repetitions  would  be  necessary  for  a complete  system, 
but  I gave  this  low  priority  here.  This  decision  was  based  on  the  assumption 
that  enough  of  the  variation  in  the  original  text  would  come  through,  so  that 
sentences  in  the  output  would  not  be  carbon  copies  of  each  other  structurally. 
As  a system  became  more  refined,  however,  it  would  need  good  heuristics,  since 
the  different  specialists  are  biased  toward  particular  syntactic  types  - the 
ones  that  they  try  first  - and  it  would  be  easy  to  fall  into  structural 
repet i tions. 

For  lexical  repetitions,  another  useful  distinction  is  between  function 
words  and  the  rest.  Function  words  are  prepositions,  binders,  and 
conjunctions.  Since  they  form  a closed  est,  it  would  be  preferable  to  handle 
them  by  anticipation,  rather  than  backup.  Let  us  look  at  the  system's 
behavior  for  prepositional  repetitions,  ths  only  check  of  this  sort  currently 
implemented.  Uhen  a preposition  is  to  be  generated  by  the  system,  the 
preposition  group  specialist  first  looks  back  through  what  has  been  generated, 
stopping  at  a sentence  boundary  or  the  verb  phrase  of  the  major  clause, 
whichever  comes  first.  If  other  preposition  groups  are  found,  a list  of  the 
prepositions  is  made,  with  those  that  will  be  nearest  to  our  new  preposition 
group  appearing  first.  The  call  to  TRANSL  is  then  made,  using  a tag  that  we 
have  not  yet  discussed: 
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(TRANSL  PREP  NOT*  (prepl  prep2...)  SfINOOE;  < soman ti c node>) 

The  NOTt  directs  the  dictionary  routine  to  try  to  avoid  theee  word  choicee. 

If  there  is  no  other  choice  available,  the  situation  is  not  currently  fatal, 
but  the  definition  routine  will  try,  if  possible,  to  supply  a prepoeition  from 
the  end  of  the  list,  rather  than  duplicating  a prepoeition  that  Mill  be  near 
the  new  one  in  the  sentence.  The  NOT  feature  is  currently  iepleaeiited  only 
for  words,  but  with  soee  revisions  of  the  syntactic  specialists,  it  could  aleo 
be  used  to  avoid  structural  repetitions  like  those  described  in  the  last 
paragraph. 

For  content  words,  let  us  Make  one  final  distinction!  between  eieMente  of 
coreferent  noun  groups  and  other  words.  The  generator  does  not  now  worry 
about  repetitions  aaong  noun  groups,  but  let  me  briefly  discuss  what  ! think 
is  involved  here.  The  eyetea  currently  has  three  optione  in  generating 
preferential  noun  groups.  It  can  either  reproduce  an  entire  noun  group  with 
IhA  as  deterMiner,  it  can  use  this  plus  the  sain  noun,  or  it  can  use  a 
pronoun.  That  is,  the  systea  can  refer  back  to  ”a  big  grey  octopus”  as 
ei thers 

(i)  the  big  grey  octopus 

(i  i)  this  octopus 

( i i i ) it 

No  checke  are  currently  Made  about  other  objecte  in  the  paragraph  that  Might 
have  similar  descriptions.  A sophisticated  generator  would  presumably  be  abto 
to  weigh  carefully  its  choices  about  using  reference,  balancing  distance  from 
coreferent  noun  groups,  possibilities  of  confusion  in  the  text,  and 
repetitiveness.  Any  heuristics  for  repetition  aaong  coreferent  noun  groups, 
therefore,  would  have  to  be  integrated  into  the  noun  group  special  iet  very 
careful iy. 
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All  the  rest  of  the  content  words  like  our  "evidently  evident"  example 
are  handled  using  backup.  The  heuristic  currently  used  is  that  if  the  root  of 
an  adjective,  noun,  or  verb  it  repeated  anywhere  within  an  argument  of  the 
main  verb  or  a modifier  of  the  main  clause,  then  an  attempt  ehould  be  made  to 
correct  the  situation.  This  involves  a preliminary  check  of  LEXALTLIST  and 
then  an  attempt  to  replace  the  node  or  nodes  affected.  If  this  does  not  work, 
the  repetition  is  currently  left  as  is,  but  it  would  be  possible  to  initiate 
more  extensive  backup. 

The  heuristics  used  here  are  obviously  very  simple  and  limited  ones,  and 
a good  deal  of  refinement  will  be  necessary.  Probably  the  easieet  way  to  do 
this  would  be  to  build  !n  as  many  basic  structural  and  lexical  heuristice  ae 
possible,  then  run  the  system  on  some  text.  This  would  give  the  designer  a 
chance  to  locate  the  repetitions  that  actually  sound  repetitious.  The  heart 
of  the  problem  here  eerms  to  me  to  be  the  analysis,  and  once  good  heurietice 
are  found,  their  implementation  should  be  straightforward. 

8.  '».3  Those  Lcng  German  Sentences 

Sentence  length  is  a problem  that  seems  trivial  until  one  starts  to  think 
about  it.  Bound  up  in  the  question  "How  long  should  a ssntence  be?"  are 
issues  of  the  sentence’s  role  as  a carrier  of  messages.  To  change  eentence 
length  we  have  to  know  which  information  can  be  safely  separated  out  and  which 
is  essential  to  thj>  integrity  of  the  messags.  Also  involved  here  are 
questions  about  human  memory  capacities.  Any  notion  of  sentential  complexity 
must  take  into  account  human  short-term  memory  and  processing  limitations. 
Something  that  is  complex  to  one  sort  of  system  might  be  handled  with  ease  in 
a eligibly  different  one.  Thus,  when  we  try  to  determine  what  size  a sentence 
ehculd  be,  we  have  left  surface  generation  and  are  really  talking  about  deep 
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generation:  the  process  of  organizing  Messages. 

My  system,  of  course,  is  based  on  the  assumption  that  surface  generation 
in  me  target  language  uill  bs  sufficient.  I have  assumed  that  in  general  Me 
do  not  need  to  completely  re-build  the  message  for  the  target  language,  but 
rather  can  generate  from  the  comparatively  h'gh  level  of  the  semantic 
representation.  In  most  cases,  this  seams  to  be  the  most  efficient  uay  to  go, 
and,  since  ue  uant  to  follou  the  organization  of  the  source  text  as  closely  ae 
possible,  it  seems  to  be  the  most  effective  as  uell.  In  dealing  uith  long 
sentences,  I have  continued  to  avoid  true  deep  generation,  and  I think  only 
fur  her  research  car,  determine  whether  this  Is  a virtue  or  a vice.  Let  me 
discuss  long  sentences  in  more  detail,  and  then  I uill  come  back  to  this  leeue 
below. 

First,  I should  say  that  although  academic  German  has  a certain  notoriety 
for  its  long  eentences,  the  sentence  length  problem  is  not  unique  to  the 
languages  chosen  here.  That  Is,  if  ue  were  translating  French  to  English 
instead  of  German  to  English,  sentence  length  uould  still  be  an  issue. 

Certain  things  are  aluays  easier  to  express  in  one  language  than  another;  it 
may  take  a clause  to  express  in  one  uhat  a uord  can  express  in  the  other. 
Because  of  this,  it  is  possible  to  start  from  an  uncomplicated  sentence  in  any 
source  language  and  end  up  uith  either  a very  large  and  complex  ranelatioh  or 
a succession  of  very  short  sentences  that  should  be  combined. 

In  the  system,  I have  concentrated  on  dealing  uith  sentences  that  are  too 
long.  Thir  uas  strictly  the  result  of  time  limitation,  since  short  sentences 
can  be  just  as  stylistically  offensive,  and  therefore  potential  !y  distracting, 
ae  long  ones.  (Although  possibly  short  sentences  are  not  ae  hard  on 
comprehensibility.)  I should  also  add  that  tne  heuristics  In  the  system  are 
very  fragmentary  and  uere  added  more  to  introduce  the  Issue  than  to  attempt 
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any  sort  of  comprehensive  answer  to  the  probism. 

The  first  question  that  must  bo  asked  is  "How  long  is  toe  long?",  which 
should  be  immediately  reformulated  -';s  "How  complex  Is  too  complex?".  It  le  a 
common  observation  that  iterative  structures  are  easier  for  people  to 
understand  than  recursive  ones.  Ludwig  Reiners  (30t  warns  against  the  dangers 
of  "Klemmkonstruktionen,"  or  successive  embedding  of  clauses.  So  length  alone 
Is  not  the  problem  here,  although  oftsn,  of  course,  excessively  complex 
eentencee  are  also  excessively  long.  Length  ie  one  factor  in  complexity,  but 
not  the  only  one.  The  recursive  structures  mentioned,  in  fact,  exemplify  one 
very  important  contributor  to  complexity.  Uhsnevsr  a number  of  things  are 
started  but  not  finished,  ue  can  expect  the  complexity  level  to  be  high. 
Similar,  but  not  identical,  is  the  complexity  introduced  by  back  references. 

If  ue  have,  say,  three  back  references  in  the  same  sentence,  ue  are  not  only 
fighting  potential  ambiguities,  but  also  the  overhead  of  simply  maintaining 
the  links  between  coreferent  items.  The  complexity  introduced  by  an 
unfamiliar  uord  or  by  complicated  semantic  content  must  also  be  reckoned  with. 

Sentential  complexity  seems  to  be  an  addltivs  phenomenon.  Some  sentences 
that  I consider  too  complicated  in  English  eeem  to  be  difficult  not  because 
they  contain  a single  complicated  structure,  but  rather  as  a result  of  a 
compounding  of  complexity.  To  see  what  I mean  by  this,  consider  our  prize 
example  sentence  and  a translation  that  parallels  the  sentential  organization 
of  the  Germanj 

(i)  Ein  deutlich  sichtbares  Zeichen  fOi  dig  im  Nervensystem  verlaufenden 
Eregungen  ist  das  Spiel  der  Chromatophoren  der  Cephalopoden,  jener  unter 
der  Haut  liegenden  gelb,  braun,  schwarz,  violett  Oder  karmlnrot  gefflrbten 
Zellen,  die  eich  entweder  zueammenzlehen  Oder  durch  radiSr  Ansetzenden 
Muskeln  fISchenhaft  ausgebreitet  werden  kfinnen. 

(i)  A clearly  visible  indication  of  the  excitatic-ns  that  run  through  the 
nervous  system  is  the  play  of  the  chromatophores  of  the  cephalopod,  those 
yellow,  brown,  black,  purple  or  carmine  colored  cells  that  lie  under  the 
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skin,  and  uhich  wither  contract  or  can  be  spread  out  under  ths  ekin 
surface  by  radially  affixed  muscles. 

This  translation  Mould  sound  better  if  tuo  English  sentences  uere  used,  but 
Mhat  about  the  follouing? 

(ii)  Ein  interessantes  8el spiel  davon  1st  das  Spiel  der  Chroma tophoren, 
jener  unter  der  Haut  liegsnden  gelb,  braun,  schuarz,  violett  Oder 
karminrot  gefSrbten  Zellen,  die  sich  entueder  zusammenzlehon  Oder  durch 
radiSr  ansetzenden  fluskeln  flfichenhaft  ausgebrwitet  uerden  kOnnen. 

(ii)  An  interesting  example  of  this  is  the  play  of  the  chroma tophoree, 
those  yellou,  broun,  black,  purple  or  carbine  colored  cells  that  lie 
under  the  skin,  and  uhich  'ither  contract  or  can  be  epread  out  under  thm 
skin  surface  by  radially  affixed  muscles. 

To  mo,  the  English  tn  (ii)  i'  fine  as  a single  sentence.  Furthermore,  I mm 

not  overly  disturbed  by  a sentence  like: 

(iii)  A clearly  visible  indication  of  the  excitations  that  run  through 
the  nervous  system  is  the  play  of  the  chromatophores  of  the  cephalopod, 
those  yellou,  broun,  black  or  carmine  colored  cells  that  lie  under  the 
skin. 

Therefore,  it  seems  to  me  that  no  one  structure  (say,  an  embedded  one)  can  be 
considered  complex  except  uith  respect  to  its  context.  One  more  clause  can 
tip  the  balance  in  an  otheruiee  acceptable  sentence,  but  ue  can  not  pin  the 
blame  on  the  clause  alone:  it  is  ths  uhcJe  sentence  (at  least)  that 
contributes  to  judgements  abou*  complexity. 

It  is  not  aluays  easy,  then,  to  decide  uhich  sentences  should  be  broken 
doun  into  smaller  ones.  In  this  respect,  1 think  people  have  an  easier  time 
of  it  than  machines,  since  they  have  a very  direct  method  of  determining 
complexity:  if  the  mind  boggles,  it's  too  complex.  Computers,  uhose  minds 

are  not  structured  in  the  same  uay,  don’t  boggle  ir.  the  same  uay.  But  even  if 

ue  lack  a model  of  human  memory  and  processing,  1 think  it  ie  possible  to 

derive  a measure  for  sentential  complexity.  By  analyzing  sentences  judged  by 
people  to  be  too  complex,  it  should  be  possible  to  come  up  uith  a formula  - 

not  necessarily  a simple  one,  though  - to  predict  uhich  serif  „es  are 
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acceptable  and  uhich  are  not. 

A look  at  the  specific  cases  handled  in  the  systea  :iO'jld  probably  be 
helpful,  but  before  the  "uhat,*  I aunt  again  consider  the  question  "uhen." 
Mhen  ehould  the  translating  systea  aako  these  checks  on  sentence,  or  more 
properly  aeseage,  length?  There  seea  to  be  several  options.  First,  there  ie 
the  deep  generation  approach,  if  ue  start  our  generation  proceee  froa  a eet 
of  aeeert<o  > froa  the  data  base  of  the  deductive  coaponent,  ue  can  include 
liaitatione  on  hou  large  or  deop  a ssaantic  representation  should  be,  or  uhat 
patterns  of  linkage  can  occi;r.  Alts,  natively,  ue  can  retain  a eurface 
generation  scheae  but  do  coplexity  analysis  on  the  eeaantic  representation. 
Ue  uould  be  using  the  saae  sort  of  inforaation  (although  probably  not 
identical  prograae)  as  for  the  deep  generation  approach,  but  ue  uould  be 
analyzing  a structure  after  it  has  been  built,  not  In  the  proceee  of  building 
it.  The  third  approach  is  for  the  surface  generator  to  aonitor  itself.  If 
the  output  has  becoae  too  complex,  then  suitable  action  can  be  taken  to  eplit 
the  eeaantic  representation,  possibly  reforaulating  soae  part  of  it  in  the 
process. 

I choee  the  third  alternative  for  the  systea,  priaarily  because 
complexity  of  expression  is  language-dependent,  uhile  the  eeaantic 
representation  is  a gesture  touard  language  independence.  In  a simple 
inspection  of  the  eeaantic  representation,  ue  cannot  tell  uhether  a relation 
can  be  expreseed  by  a uord,  or  uhether  a clause  will  be  necessary.  In  the 
present  systea,  it  is  easy  enough,  of  course,  to  deteralne  uhether  eingle 
uords  do  exist  for  a given  concept.  The  point  is,  houever,  that  ue  do  not 
knou  uhether  a particular  uord  can  be  used  in  the  translation  until  ue  take 
Into  account  both  the  interrelationships  betueen  parts  of  the  aessage  and  the 
linguistic  constraints  on  structuring  In  the  sentence. 
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To  bring  the  discussion  down  to  a more  concrete  level,  let  us  continue 
uith  the  example  sentence  given  and  decide  what  factors  contribute  to  its 
complexity.  The  heuristics  presented  here  are  clearly  ad  hoc,  and  they 
res.  esent  the  only  case  currently  handled  by  the  system.  I think  th^y 
suggest,  however,  the  direction  In  which  one  should  proceed.  The  Englieh 
example,  again,  was: 

(i)  A clearly  visible  indication  of  the  excitations  that  run  through 
nervous  system  is  the  play  of  the  chromatophores  of  the  cephalopod,  those 
yellow,  brown,  black,  purple  or  carrine  colored  celle  that  lie  under  the 
skin,  and  which  either  contract  or  can  be  spread  out  under  the  skin 
surface  by  radially  affixed  muscles. 

Pne  factor  here  seems  to  be  the  subject  of  the  sentence:  "a  clearly  visible 

indication."  Ue  notice  that  indication  is  a relation  participant  noun,  and 
that  the  other  argument  of  the  relation  VINDICATE  (the  thing  indicated)  ie 
present  as  a preposition  group  ("of  the  excitations").  Ue  can  call  a eimpie 
nominal  ization  (e.g.  any  gerund)  or  relation  participant  noun  "eaturated"  if 
all  the  arguments  of  the  relation  appear  explicitly  in  the  noun  group.  The 
subject  of  sentence  (i)  is  therefore  saturated.  Further,  if  a saturated  noun 
group  contain*  a postnominal  rankshifted  qualifier  modifying  one  of  the 
arguments  of  the  relation,  we  can  call  it  "supersaturated."  The  eubject  in 
(i)  ie  also  supersaturated,  due  to  the  RSQ  clause  that  modifies  exci  tat  ions 
("that  run  through  the  nervous  system").  Ue  would  expect  a supersaturated 
noun  group  to  be  a key  contributor  to  sentential  complexity,  but  note  that 
supersaturation  alone  is  not  enough  to  cause  rejection  of  a sentence  (example 
( i i 5 above) . 

A further  difficulty  with  sentence  (i)  is  the  appositive  phrase  that 
starts  uith  "those  yellow,  ...  and  carmine  colored  cells."  Here,  two 
postnominal  RSQ  clauses  modify  cells,  and  in  English  we  would  tend  to  conjoin 
the  two  using  and.  Furthermore,  the  second  postnominal  clause  here  ("uhich 
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either  contract  or  can  be  epread  out  ...")  is  itself  conjoined  bg  either  / qc.. 
Thie  double  level  conjunction  looks  like  an  important  contributor  to 
complexity,  but  it  is  difficult  to  tell  uhere  to  draw  the  line.  If  our  second 
clause  were  “and  which  either  expand  or  contract,*  the  appoeitive  would 
probably  not  be  too  long.  In  (i),  however,  the  two  clausee  are  not  parallel, 
fho  first  ie  active,  and  the  second  is  passive.)  This  seems  to  push  the 
appositive  over  the  line.  Let  ue  say,  then,  that  an  appositive  can  be 
coneidered  complex  if  it  goes  beyond  two  levels  of  parallel  conjunction,  or 
beyond  one  level  of  non-parallel  conjunction.  Once  again,  a complex 
appoeitive  alone  should  not  trigger  rejection  of  a sentence,  since  example 
(ii)  above  does  not  seem  to  be  too  complex. 

By  combining  a euper saturated  noun  group  with  a complex  appoeitive  ae 
defined  above,  ue  do  get  a sentence  that  is  too  complex.  In  dealing  with  such 
a sentence,  ue  would  expect  a generator  to  interrupt  processing  if  it  detecte 
an  output  that  satisfies  both  complexity  conditions.  Ir.  the  caee  of  example 
(i),  nodes  would  then  be  popped  from  the  tree  back  to  the  beginning  of  the 
appositive,  since  appositives  and  conjunctions  are  natural  places  to  break  up 
a sentence.  Uha*  is  left  on  the  tree  (in  this  case,  everything  up  to  "the 
chromatophores  of  the  cephalcpod")  would  become  a single  sentence.  The 
appositive  t'rt  of  the  semantic  representation  wouid  be  detached  and  would 
become  the  eecond  sentence,  uith  generation  starting  from  the  top.  Note  that 
given  the  similarity  in  word  order  betueen  English  major  and  secondary 
clauses,  it  might  be  feasible  to  remodel  some  of  the  output  that  was  already 
generated  before  the  interrupt,  instead  of  discarding  it  altogether.  In  some 
cases,  houever,  this  patching  might  require  a certain  amount  of  ingenuity. 

Note  that  not  all  l^ng  sentences  can  be  split  as  easily  as  the  example 
here,  and,  for  eome,  ue  might  not  be  able  to  find  a division  that  maintains 
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the  integrity  of  the  Message.  Still,  ! think  this  example  gives  an  idea  of 
some  of  the  iosues  involved  in  handling  sentential  complexity.  1 should  also 
remark  that  this  emphasis  on  using  syntactic  criteria  to  formulate  heuristics 
may  be  misguided.  It  may  be  that  semantic  factors  should  be  considered 
heavily.  For  translation,  however,  I would  tend  to  favor  heuristics  expressed 
in  terms  of  the  surface  structure  of  the  target  language,  since  a given 
semantic  representation  has  already  been  embodied  in  a single  sentence  in  the 
source  language. 


6.5  Other  Necessary  Extensions 

Even  if  it  were  extended  to  handle  the  full  range  of  syntactic 
structures,  the  generator  discussed  here  could  not  be  said  to  be  a complete 
one.  There  are  still  some  very  important  processes  that  have  not  been 
considered,  and  I would  like  to  discuss  them  briefly  in  this  section.  Nothing 
discussed  here  is  currently  implemented,  primarily  because  a great  deal  of 
additional  apparatus  would  be  necessary. 

6.5.1  Dealing  with  Ambiguity 

Ambiguity  is  not  an  issue  for  the  generator  in  the  same  way  that  it  is 
for  the  interpreter,  but  there  are  several  questions  worth  considering.  Two 
mechanisms  for  handling  different  sorts  of  ambiguity  will  be  discussed  herei 
one  of  these  :ould  be  desirable  in  a working  translating  system  and  the  other 
would  be  quite  important. 

The  first  feature  is  the  ability  to  translate  ambigui  ty-for-ambigui  ty, 
which  was  mentioned  in  (ha  introduction.  I think  this  would  be  a useful 
mechanism  since  I find  myself  doing  it  occasionally  when  hand  translating. 

For  people,  such  an  ability  is  used  most  for  pronoun  reference  and  implicit 
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information  like  understood  agents,  etc-  For  a translating  system  with  a weak 
deductive  component,  the  ability  to  translate  ambigui ty-for-ambigui ty  might 
also  be  used  to  avoid  choosing  between  different  senses  of  a word.  Especially 
in  languages  as  close  historically  as  German  and  English,  it  is  often  poeeible 
to  find  a word  in  one  language  that  is  ambiguous  in  the  same  way  in  the  other 
language.  In  general,  a system  would  have  to  be  quite  sophisticated  to 
translate  ambigui ty-for-ambiguity,  but  at  the  lexical  level,  ue  could  make  a 
start  uith  either  an  English  interpretive  dictionary  or  with  an  associative 
ability  to  link  concepts  to  definitions.  (Currenty  in  the  system,  ue  can  ask 
what  concept  markers  are  associated  with  a German  word  or  what  English  words 
are  associated  with  a concept  marker,  but  there  is  no  way  to  find  out  easily 
what  concept  markers  are  associated  with  English  words.)  It  would  be  a 
relatively  simple  matter  to  take  two  concept  markers  produced  for  a German 
uord,  look  up  a set  of  English  words  associated  with  one  of  them,  and  see  if 
any  English  uords  in  this  set  could  also  have  the  other  concept  marker  ae  a 
meaning. 

To  translate  ambigui ty-for-ambigui ty  beyond  the  lexical  level,  the 
generator  uould  need  a model  of  the  English  interpretive  process.  The  task 
here  uould  be  to  analyze  the  uay  the  target  language  was  ambiguous  by 
inspecting  the  semantic  representation  or  by  accessing  pre-packaged  knowledge. 
The/  pre-packaged  knouledge  might  express  such  facts  as,  "In  a German 
nominal  izat i or.  of  a transitive  verb,  the  genitive  could  be  either  the  subject 
or  the  direct  object  of  the  verb,  if  no  other  participants  are  given."  The 
second  phase  of  this  task  would  then  be  to  find  an  English  structure  uith  a 
similar  ambiguity,  uhich  for  this  case  happens  to  be  an  English  nominal  izat  ion 
with  an  of.  To  use  a familiar  example, 

das  Schiessen  der  JSger  • the  shooting  of  the  hunters 
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("the  hunters  shoot"  or  "the  hunters  are  shot") 

The  model  of  structural  ambiguities  might  be  derived  automatically  from  a 
parser  of  the  language,  although  that  Mould  not  be  easg  for  the  particular 
parser  used  here.  Uherever  it  comes  from,  houever,  ue  would  want  such 
knowledge  about  ambiguities  to  f>e  detached  from  the  parser,  since  we  do  not 
want  to  have  to  simulate  the  parsing  process  every  time  we  want  to  determine 
whether  a structure  is  ambiguous. 

The  ability  to  translate  ambigui ty-for-ambigui tg  just  discussed  would  be 
attractive  in  a generator,  but  not  essential.  The  second  feature  I will 
discuss  here,  anticipating  ambiguities  in  the  output  text,  is  more  crucial,  I 
think,  since  it  relates  to  the  reliability  of  a translating  system.  Uhat  1 
uould  like  to  consider  is  the  situation  where  the  generator  unwittingly 
produces  a syntactically  or  semantically  ambiguous  sentence.  The  most  extreme 
step  one  could  take  to  avoid  this  problem  uould  be  to  feed  every  text  output 
back  into  an  English  interpreter,  to  see  if  uhat  was  produced  contained 
serious  ambiguities.  This  uould  correspond  to  a translator  reading  over  and 
correcting  a translation.  It  uould  not  be  an  absolute  assurance,  since  the 
proof-reader  uould  presumably  share  the  same  deductive  data  base  used  by  the 
rest  of  the  system,  and  knowledge  limitations  might  cause  it  to  mlse 
ambiguities  that  are  present  in  the  output  text. 

Even  if  such  a proof  reading  facility  were  available  - and  especially  if 
one  uere  not  - a generator  should  also  be  able  to  anticipate  some  ambigui  tiee 
and  avoid  them.  In  his  thesis  (19),  Hill  catalogs  four  causes  of  global 
syntactic  ambiguity  in  English: 


(1)  Choosing  between  participle  and  gerund 

(2)  Choosing  between  noun  and  verb  in  clause  first  uord  position 

(3)  Choosing  the  correct  transitivity  for  the  verb 
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(4)  Choosing  an  attachment  point  for  a modifying  phrase 
It  is  clear  that,  given  the  features  saved  on  the  generation  tree,  checks  for 
these  eorts  of  ambiguities  would  be  relatively  straightforward.  A generator 
also  might  be  able  to  anticipate  certain  semantic  confusions  about  the  ecope 
of  a quantifier.  ("Quantifier”  is  used  here  as  an  English  part  of  epeech; 
eee  Uinograd  (33, p. 67) - ) Checks  for  these  eorts  of  ambiguities  could  be  built 
into  the  eyntactic  specialists  of  a generator,  or  the  same  information  could 
be  embedded  in  a small  routine  that  would  monitor  the  generation  proceee  and 
interrupt  If  one  of  these  ambiguous  structures  uere  generated. 

6.5.2  Uhen  All  Else  Fails 

In  the  implementation  as  it  stands  now,  if  all  the  backup  poesibi  I i ties 
are  exhausted  for  a particular  sentence,  the  generator  simply  fails.  Thie 
would  obviously  be  undesirable  behavior  in  a working  translation  eystom,  and 
we  would  want  a system  to  be  able  to  make  the  best  out  of  a bad  situation. 
There  seem  to  be  two  directions  one  could  go  to  meet  this  goal,  one  being 
compromise  and  the  other  paraphrase.  Both  features  would  be  desirable  in  a 
system,  but  it  is  not  at  all  clear  how  such  behavior  could  be  produced.  The 
tuo  will  be  considered  briefly  here,  but  no  solutions  will  be  offered,  eince 
they  depend,  I think,  on  extensive  further  research. 

In  the  current  version  of  the  generator,  backup  is  handled  by  trying 
alternative  choices,  but  this  is  always  within  the  context  of  a set  of  fixed 
choices;  no  attempt  is  made  to  suspend  rules.  In  actual  situations,  it  ia 
entirely  possible  that  no  combination  of  permissible  choices  adequately 
translates  the  original,  and,  in  this  case,  we  uould  want  to  produce  the  beet 
approximation  possible.  Thie  could  be  done  either  by  leaving  out  some  of  the 
content  of  the  original,  or  by  violating  one  or  more  of  the  rules  of  the 
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target  language.  (The  other  alternative  is  paraphrase,  which  is  diecueeed 
beiou.)  In  general,  when  translating  scientific  texts  we  will  choose  to 
violate  rules  rather  thar.  to  leave  out  content.  The  choice  of  which  rules  to 
suspend,  however,  can  be  8 difficult  one,  and  in  arriving  at  this  decision,  we 
eight  get  involved  in  delicate  trade-offs  between  different  possibilities. 

The  generator  would  probably  need  the  ability  to  produce  a set  of  aiternative 
trees  for  uhich  different  rules  had  been  suspended  and  then  use  eoee  set  of 
criteria  to  determine  uhich  represented  the  best  coeproeiee.  This  ability  to 
eahe  compromises  would  be  important  in  a working  generator,  since  it  often 
eeeme  that  the  essence  of  translation  is  the  ability  to  find  good  compromieee. 

If  no  satisfactory  compromise  can  be  found,  the  next  step  is  to  try 
paraphrase.  ! am  using  "paraphrase”  in  a special  sense  here  to  mean  a change 
in  the  explicit  meaning,  although  not  in  the  total  meaning  of  a text.  Let  me 
give  a simple  example  of  a situation  in  uhich  explicit  meaning  differs  but  in 
which  total  meaning  is  equivalent.  The  English  phrase  "a  clear  day"  appeare 
in  German  as  "ein  heller  Tag"  (literally,  "a  bright  day").  Obvioueiy,  if  the 
sky  is  clear  of  clouds,  then  the  sun  can  be  expectsd  to  shine  brightly,  and  if 
the  sun  is  bright,  we  expect  the  sky  to  bs  clear.  The  two  languagee  pick  up 
on  different  ends  of  this  i f-and-only-i  f relationship.  But,  although  expilclt 
statements  differ,  the  implication  is  still  roughly  equivalent. 

This  particular  example  would  probably  best  be  handled  in  dictionary 
definitions,  by  translating  he  1 1 as  clear  under  certain  circumstances;  we 
probably  would  not  use  a general  paraphrase  mechanism.  Not  all  possible 
paraphrases,  of  course,  can  be  anticipated  in  this  way.  if  the  generator 
cannot  translate  a phrase,  us  will  want  it  to  consider  the  implications  to  eeo 
if  another  equivalent  phrase  can  os  found.  This  will  involve  a return  to  the 
deductive  component,  since  only  a fraction  of  the  implicit  meaning  of  a 
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sentence  is  carried  in  the  semantic  representation.  T^e  deductive  component 
uould  presumably  find  an  equivalent  paraphrase,  alter  the  semantic 
representation,  and  send  this  neu  representation  back  to  the  generatnr  for 
another  try. 


*** 

Although  the  generator  currently  implemented  is  very  limited  in  scope,  I 
have  tried  to  foresss  the  kinds  of  extensions  that  uould  be  neceseary.  The 
important  features  of  the  generator  are  that  it  uses  the  semantic 
representation  as  input  and  that  it  is  not  constrained  to  generate  components 
in  the  linear  order  that  they  ui  1 1 appear  in  a sentence.  Uith  the  extensions 
made  to  PROGRAfflAR,  ue  ^n  maintain  a generation  tree,  and  it  is  possible  to 
by-pass  syntactic  specialists  or  definition  routines,  to  specify  a definition 
list  to  be  used,  or  to  explicitly  rule  out  particular  uord  choices.  Emphasis 
has  been  placed  on  some  problems  that  are  traditionally  considered  stylistic, 
but  uhich  are  of  considerable  importance  for  translation.  A great  deal  more 
analysis  needs  to  be  done  on  the  semantic  motivation  for  particular  syntactic 
choices,  and  the  generator  uould  also  benefit  from  investigations  of  problemo 
such  as  repetitiveness  and  sentence  length.  Finally,  the  issues  discussed  in 
section  8.5  - avoiding  ambiguity,  suspending  rules,  and  paraphrase  - are 
problems  that  are  uide  open  for  further  research. 
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Chapter  7 — Conclusions 

In  the  course  of  describing  the  implementation,  I have  dlecueeed  eome 
problems  and  some  solutions.  Wot  all  of  the  problems  have  been  satisfactor  1 ly 
solved,  and  among  these  are  some,  I think,  that  are  Interesting  enough  to 
justify  more  intensive  research.  In  this  final  chapter,  let  me  review  uhat  I 
consider  to  be  the  major  problems  encountered  in  this  project  and  make  eome 
remarks  about  the  different  solutions  proposed. 

Heading  the  list  of  problems  in  oechanical  translation  is  still,  of 
couree,  the  problem  of  understanding.  This  uas  outside  the  ecope  of  the 
project,  but  I want  to  emphasize  again  here  that  true  understanding  of  the 
source  text  is  crucial  to  trustworthy  translation.  Related  to  this  is  the 
issue  cf  accountability.  A user  should  aluays  be  able  to  ask  a system  uhat 
choices  uere  made  and  uhy.  Just  as  a human  translator  could  give  reasons  for 
a particular  disambiguation  or  uord  choice,  I think  It  le  essential  that  a 
system  be  able  to  do  the  same.  This  uill  not  guarantee  reliability,  but  it 
does  give  the  user  some  control  by  giving  him  a chance  to  catch  gaps  in  the 
knouledge  base,  incorrect  assumptions,  etc. 

The  first  problem  encountered  in  the  implementation  uas  that  of  parsing 
German  text.  Here,  there  were  two  difficult  areas  - German  Inflection  and  the 
relatively  uide  (compared  to  English)  syntactic  variety,  i.e.  pronominal 
clauses,  the  relative  freedom  of  word  order  for  verb  objects,  end-order 
constructions,  etc.  The  former  involved  changes  to  PROGRAHHAR  to  handle 
multiple  feature  lists.  These  changes  uere  extensive,  although  of  a routine 
nature.  If  PROGRAHflAR  had  originally  been  written  to  handle  Russian  or 
Icelandic,  the  morphology  of  German  uould  not  have  come  as  such  a shock. 
English  is  biased  almost  exclusively  touard  uord  order  in  the  linguietlc 
trade-off  betueen  morphopho I ogy  and  uord  order,  so  one  uould  expect  to  need 
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fairly  extensive  changes  in  order  to  handle  a store  heavily  Inflected  language. 

Uitn  respect  to  actual  parsing  performance,  1 would  say  that  the  general 
approach  used  by  Uinograd  is  as  good  at  handling  German  as  It  is  at  handling 
English.  That  is  to  eay,  the  performance  of  the  parser  leaves  no  doubt  that 
it  could  someday  be  extended  and  embedded  In  a practical  system.  There  remain 
certain  trouble  spots,  however,  that  are  present  In  English  but  are 
exacerbated  in  German.  The  implementation  uses  a number  of  ploys  to  deal  with 
the  more  varied  syntactic  choices  of  German,  but  It  Is  not  clear  that  the 
solution  is  general  enough.  The  recent  dissatisfaction  expressed  about  backup 
in  language  parsing  seems  to  be  well-founded,  and  it  will  be  interesting  to 
see  the  results  in  this  area. 

A key  question  in  mechanical  translation  Is  what  the  input  to  the 
generator  should  look  like.  In  designing  the  Implementation,  ! started  with 
two  assumptions  about  this  issue.  The  first  was  that  for  a given  target 
language  we  can  predict  the  sorts  of  information  that  will  be  necessary  for 
generation  and  the  sorts  that  will  not.  Second,  1 assumed  that  surface 
generation  would  be  enough,  that  the  generator  could  follow  the  general 
organization  of  the  source  text  sentence  for  sentence.  These  are  based.  In 
turn,  on  the  underlying  hypothesis  that  translation  of  scientific  prose  does 
not  need  the  full  power  of  a general  purpose  generator.  Adopting  these 
assumptions  resulted  in  a commitment  to  the  use  of  a semantic  representation 
as  input  to  the  generator.  In  chapter  6,  we  saw  that  these  assumptions  do  not 
always  hold.  Some  situations  require  paraphrase,  and  in  others  we  might  have 
to  restructure  the  message  entirely.  I think  they  are  true  often  enough, 
however,  to  justify  substantial  differences  between  the  form  of  generators  for 
translation  and  general  purpose  generators.  I could  be  wrong  in  this, 
however,  and  only  Increased  research  wi  1 1 tell  whether  efficiency  lies  In  the 
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direction  of  a special  purpose  or  of  a general  generating  process. 

There  are  many  aspects  of  the  two  languages  considered  here  that  I Mould 

like  to  have  investigated  in  more  detail.  All  of  these.  I think,  are 
interesting  research  areas  in  their  own  right,  irrespective  of  ttv 
Implementation  Involved.  Only  a token  gesture  uae  made  toward  using 

information  about  collocations  for  parsing  and  generation.  It  would  be 

interesting  to  see  how  this  information  could  be  used  to  build  up  lexical 
expectations  about  the  rest  of  the  sentence,  in  addition  to  the  syntactic 
expectations  currently  embedded  in  the  parser.  Furthermore,  the  area  of 
generation  poses  a number  of  interesting  questions,  many  of  which  have  been 
given  only  rudimentary  answers  here.  Issues  of  word  choice  avid  sentence 
length  deserve  more  attention.  A good  dea!  more  analysis  needs  to  be  done  on 
questions  of  semantic  motivation  for  surface  structure  choices.  Finally, 
another  very  interesting  problem  is  that  of  suspending  rules  to  make  good 
generating  compromises. 

Throughout  this  project,  I have  been  continually  impressed  by  both  the 
economy  of  natural  language  as  a communication  medium  and  the  variety  of  ite 
mechanisms.  ! find  this  convincing  evidence  that  any  translating  system  that 
throws  away  information,  be  it  syntactic,  lexical,  or  eemantic,  cannot  hope 
for  success.  In  the  end,  only  a total  approach  to  language  will  offer  even  an 
initial  solution  to  the  translation  problem,  ar.d  a lot  of  intriguing  questions 
still  remain  unanswered. 
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APPENDIX  A.  UORD  FEATURES 


UORD  DEFINITIONS  FOR  THE  INTERPRETIVE  GRAMMAR  REQUIRE  THE  FOLLOUING  SYNTACTIC 
INFORMATION. 

STARREO  FEATURES  INDICATE  REQUIRED  MATCHES  IN  INFLECTION.  FEATURES  WITH  OOTS 
INDICATE  TYPES  OF  FEATURES: 

PERSON-  P1ST  P2NO-FAH  P2NO-POL  P3RD 
GENDER-  MASC  FEM  NEUT 
CASE-  NOM  GEN  DAT  ACC 
NUMBER-  SING  PLUR 


ADJECTIVE.  EITHER  ONE  THAT  CAN  BE  DECLINED  OR  NOT. 

COMP  -FORMS  COMPARATIVE 
SUP  - FORMS  SUPERLATIVE 

IF  A SUPERLATIVE  OR  COMPARATIVE  IS  ACTUALLY  FOUND  THEN  THE  FEATURES  SUPERL  AND 
COMPAR  ARE  ADOED. 

ATTRIBUTIVE  ADJECTIVES: 

(ADJ  ATTR  DECL  COMP  SUP) 

COMPLEMENTS: 

(ADJ  NODECL  COMP  SUP  .CASE.  ) 

N006J 

ADJECTIVES  THAT  MOOIFY  VERBS  OR  OTHER  ADJECTIVES: 

(ADJ  RELMOO  NOOECL  COMP  SUP  ) 

THOSE  RELMOO  ADJECTIVES  THAT  MAY  NOT  APPEAR  IN  THE  FIRST  POSITION  IN  THE 
SENTENCE: 

(ADJ  RELMOO  NON-FRONTAL) 

POST NOM INAL  ADJECTIVES: 

(ADJ  POSTNOM  NOOECL) 

U.  c FUR: 

(/uJ  INTER  NOOECL  .CASE.) 

UO,  UARUM.  UOHIN,  ETC.: 

(ADJ  INTER) 

UCRUBER , UOR^JS,  UOZU,  ETC. : 

(ADJ  INTER  ' .-FORM) 

ADVERB  MODIFYING  ADJECTIVES  ANO  OTHER  ADVERBS: 

(AOV) 

BINDERS: 

(BINDER) 


COORDINATING  CONJUNCTIONS: 
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(CONJ) 

OER  OIE  OAS  ETC.: 

(OET  DFF  .GENOER.  .CASE.  .NUMBER.  ) 

D1ESE  Jv  ETC.: 

(ENDIN'.  iTERMINE  GENOER,  CASE  8 NUMBER) 

(OET  Ob  ^OJ) 

E1N  KEIN  EINIGE: 

(ENDINGS  DETERMINE  GENOER,  CASE.  8 NUMBER) 

(OET  INOEF  SING) 

PLUR 

UELCHE: 

(DET  INTER  OECU 
UESSEN: 

(DET  INTEH  NCJOECL  P.GEN) 

MEIN  OEIN  ETC.: 

(ENDINGS  DETERMINE  GENOER.  CASE  8 NUMBER.  SEE  POSS-SUBT  FOP  P.) 

( DET  POSS  P. PERSON.  P. GENOER.  P. NUMBER.  ) 

JA.  NEIN,  OANKE,  AHA: 

INTERJECTION) 

STRONG  NOUNS.  THAT  IS  THOSE  THAT  HAVE  A REGULAR  DECLENSION: 

(NOUN  STRONG  .GENDER.  GEN-ES  NOPLJR  ) 

GEN-S  PtU<0 
PLIjR-EN 
PLUR-E 
PLUR-ER 
PLUR-N 
PLUR-E 
PLUR-ER 
PLUR" 

IF  THE  NOUN  MAY  TAKE  MORE  THAN  ONE  GENITIVE  OR  PLURAL  ENDING.  THESE  ARE  LISTED 
SIOE  BY  SIDE  IN  THE  FEATURE  LIST,  RATHER  THAN  IN  SEPARATE  ENTRIES. 

UEAK  NOUNS.  LIKE  SOLOAT.  MENSCH,  ETC.: 

(NOUN  UEAK  .GENOER.) 

MIXEO  NOUNS: 

(NOUN  MIXED  .GENDER.) 

NOTE:  ALL  NOUNS  ALSO  MAY  BE  EITHER  COUNT,  MASS  OR  PROPN  (PROPER  NOUN).  SHOULD 
A PARTICULAR  NOUN  BELONG  TO  MORE  THAN  ONE  oF  THESE  CATEGORIES  THE  FEATURES 
UILL  BE  L1STEO  TOGETHER  IN  THF  <*AME  UAY  THAT  THE  TRANSITIVITY  PROPERTIES  ARE 
FOR  THE  VERB. 

UEAK  ANO  MIXED  nOUNS  MAY  INCLUDE  GENITIVE  ENOINGS  IN  .RREGULAR  CASES. 


CARO INAL  NUMBER: 


183 


(Nun) 

□IE  MEINIGE,  DIE  HEINE,  ETC. 

INFORMATION  PREFIXED  BY  *P*  REFERS  TO  FEATURES  OF  THE  PRONOUN  ITSELF,  UHILE 
UNPREFIXED  INFORMATION  (GENOER  CASE  ft  NUMBER)  HILL  BE  AOOEO  UHEH  THE  ENDING  IS 
EVALUATED. 

(POSS-SUBST  P.  GENOER.  P. PERSON.  P. NUMBER  ) 

PREPOSITION: 

(PREP  .CASE.  PRE  ) 

POST 

MAN  JEMANO  ETC. : 

(ENDINGS  SUPPLY  CASE  ft  NUMBER) 

(PRDN  ABSTRACT  INOEF  ) 

L1FR  LIAR* 

(PRDN  INTER  .CASE.) 

MEIN-  ETC. 

(SEE  POSS-SUBST  FOR  EXPLANATION  OF  P.  ENDINGS  DETERMINE  GENDER,  CASE,  + 
NUMBER.) 

(PRGN  PDSS  P. GENDER.  P. PERSON.  P. NUMBER.) 

DA -COMPOUNDS: 

(PRON  PREP  RELMOO) 

ER  SIE  ES  ETC.: 

CASE  MAY  BE  EITHER  (NOM  GEN  DAT  ACC  REFL  UEMF) 

(PRON  PERS  DEF  .PERSON.  .GENDER.  .CASE.  .NUMBER.  ) 


DAS.  UAS.  DA: 

(PRON  PERS  RELMOO) 

EIN,  KEIN: 

(ENDINGS  SUPPLY  CASE  ft  NUMBER) 

(PRON  PERS  INDEF  ) 

DER,  DEREN.  UELCHE,  ETC,: 

(PRON  REL  .CASE.  .GENDER.  .NUMBER.) 

SELBST,  ALL,  ETC.: 

(QUANT  MASS  ) 

COUNT 

PARTICLE  USED  AS  SEPARABLE  PREFIX: 
(SEPPR ) 


VERB: 

(VERB  REG  UML  SEIN  .TRANSITIVITY. 

IRR  — HABEN 

MIXED 


-SEPPR  .SEPPR.) 

+SEPPR 

INSCPPR 


184 


IF  -SEPPR,  THEN  THE  SEPARABLE  PREFIX  IS  GIVEN.  FOR  SEPARABLE  PREFIXES,  BOTH 
PARTS  OF  THE  UORO  nUST  BE  ENTERED  SEPARATELY  IN  THE  DICTIONARY,  ALTHOUGH 
SEMANTICS  NEED  ONLY  BE  HUNG  ON  THE  COMPOUNO.  THE  COMPOUNO  ENTRY  IS  LABELED 
UITH  +SEPPR  ANO  OOESN'T  NEED  THE  INDIVIDUAL  SEPPR  SPECIFIED,  EITHER  IN  FEATURE 
LIST  OR  COLLOCATIONS. 

TRANSITIVITIES  ARE: 

A+O  R+A  U+A  A+G  A+A  R+O  R+G  A+P  A»E  R+E  ZAORGNUPE  I 

I - 1 NTRANSi  T I VE  A-ACCUSATIVE  D-OATIVE  G-GENITIVE  N-NOM I NATIVE  R-REFLEX1VE 
U- (FOR  UEMFALL)  OATIVE  REFLEXIVE  P-PREPOSITION  AS  OBJECT  Z-RANKSHIFTEO  NOUN 
GROUP  E-ANY  AOVERBIAL.  SOME  VERBS  HAVE  OBLIGATORY  LOCATION,  TIME,  ETC.  JUST 
UHICH  CASE  APPLIES  !S  SPECIFIED  ROUGHLY  IN  SEMANTIC  RESTRICTIONS. 

IF  A VERB  HAS  MORE  THAN  ONE  TRANSITIVITY  RELATION,  THESE  ARE  INCLUDED  IN 
PARENTHESES  IN  ONE  DEFINITION,  RATHER  THAN  MAXING  SEPARATE  LISTS  FOR  EACH  ONE. 
THESE  LISTS  ARE  THEN  EXPANOEO  AUTOMATICALLY  WHEN  ENCOUNTERED. 
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APPENDIX  B.  SAMPLE  PARSE 


EIN  OEUTLICH  SICHTBARES  ZEICHEN  FOR  DIE  IM  NERVENSYSTEM  VERLAUFENOEN 
ERREGUNGEN  1ST  DAS  SPIEL  OER  CHROMATOPHOREN. 


i((EIN  DEUTLICH  SICHTBARES  ZEICHEN  FOR  OIE  IM  NERVENSYSTEM  VERLAUFENOEN 
ERREGUNGEN  1ST  DAS  SPIEL  DER  CHRPTiATOPHOREN  ) 

(CLAUSE  MAJOR  TOPLEVEL  DECLARATIVE  REGULAR-OROER) 

((EIN  OEUTLICH  SICHTBARES  ZEICHEN  FOR  OIE  IM  NERVENSYSTEM  VERLAUFENOEN 
ERREGUNGEN) 

(NG  NOM  FULL  NOUN  DET  INOEF  t :UT  SING  P3RD  COUNT) 

(EIN  (DET  INDEF  SING  NEUT  NOM)) 

((DEUTLICH  SICHTBARES)  (AOX  ATTR  NEUT  SING  MIXED  NONEX) 

(OEUTLICH  (ADJ  RELMOO  UNOECL  COMP  SUP)) 

(SICHTBARES  (ADJ  ATTR  OECL  MIXEO  NEUT  NOM  SING  COMP  SUP))) 

(ZEICHEN  (NOUN  STRONG  NEUT  NOM  SING  P3RO  GEN-S  PLUR8  COUNT)) 

((FOR  DIE  IM  NERVENSYSTEM  VERLAUFENOEN  ERREGUNGEN) 

(PREPG  SIMPLE) 

(FUR  (PREP  ACC  PRE* ) 

((DIE  IM  NERVENSYSTEM  VERLAUFENOEN  ERREGUNGEN) 

(NG  ACC  SIMPLE  DET  DEF  NOUN  PLUR  MASC  P3RD  COUNT) 

(DIE  (DET  DEF  ACC  FEM  PLUR)) 

((IM  NERVENSYSTEM  VERLAUFENOEN) 

(CLAUSE  RSQ  PRESP  PRENOM  NONEX  SUBORDINATE  FEM  PLUR  ACC  UEAK) 

((IM  NERVENSYSTEM) 

(PREPG  NO -RSQ  ADVERBIAL) 

(IM  (PREP  MIXED  PRE) ) 

((IM  NERVENSYSTEM) 

(NG  DAT  NO -RSQ  DET  DEF  NOUN  NEUT  SING  P3RD  COUNT) 

(IM  (DET  DEF  NEUT  DAT  SING)) 

(NERVENSYSTEM 

(NOUN  STRONG  NEUT  DAT  SING  P3RD  GEN-S  PLUR-E  COUNT)))) 

(VERLAUFENOEN 

(Part  PRESP  OECL  UEAK  FEM  ACC  PLUR  ATTR  IRR  UML  SEIN  NO-GE 
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nVB  PLAIN  P AS-VERB) ) ) 

(ERREGUNGEN  (NOUN  STRONG  FEU  ACC  PLUR  P3RD  PLUR-EN  COUNT))))) 

(1ST  (VER8  IRR  MVB  PLAIN  SEIN  NO-ENO  N PRES  INOIC  P3R0  SING)) 

((DAS  SPIEL  DER  CHRQflATOPHOREN) 

(NG  NOM  FULL  DET  OEF  SING  NEUT  NOUN  P3RO  COUNT) 

(OAS  (DEI  DEF  NOM  NEUT  SING)) 

(SPIEL  (NOUN  STRONG  NEUT  NON  SING  P3RO  GEN-S  GEN-ES  PLUR-E  COUNT)) 
( (DER  CHROMA T OPHOREN ) 

(NG  GEN  SIMPLE  OET  DEF  NOUN  PLUR  MASC  P3RD  COUNT) 

(DER  (OET  DEF  GEN  MASC  PLUR)) 

(CHROMATOPHOREN  (NOUN  PLUR-EN  PLUR  P3R0  GEN  GEN-S  MASC  COUNT)))))) 
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APPENDIX  C.  A SECTION  OF  THE  CONCEPT  MARKER  TREE 


EACH  CONCEPT  MARKER  IS  LINKED  TO  ITS  PARENT  BY  THE  i£  PROPERTY  ANO  TO  ITS 
DAUGHTERS.  IF  ANY.  BY  OOUN.  THE  ORDERING  OF  RESTRICTION  LISTS  CORRESPONDS  TO 
THE  ORDER  OF  THE  SEMANTIC  ARGUMENTS  OF  THE  RELATION. 

(DEFS  Z/MENl'AL-PRXESS  UP  //RELATION 
OOUN  (//PERCEPTION  //REACTION  //COGNITION)) 

(DEFS  //PERCEPTION  UP  //MENTAL-PROCESS 
DOUN  (//SENSORY- INVOLUNTARY  ASENSORY-VOLUNTARY) ) 

(DEFS  //SENSORY- INVOLUNTARY  UP  //PERCEPTION 
DOUN  (//DISTINGUISH  //PERCEIVE) ) 

(DEFS  //DISTINGUISH  UP  /KSENSORY-I NYOLUNTARY 
RESTRICTIONS:  (/ZLI VING-THING  //CONCRETE  //CONCRETE)) 

(DEFS  //PERCEIVE  UP  //SENSORY- INVOLUNTARY 
DOUN  (/(SEE) ) 

(DEFS  //SEE  UP  //PERCEIVE 
RESTRICTIONS:  (//ANIMAL  //CONCRETE) ) 

(DEFS  //SENSORY- VOLUNTARY  (//PERCEPT  I ON) 

DOUN  (//OBSERVE)) 

(DEFS  //OBSERVE  UP  //SENSORY-VOLUNTARY 
RESTRICTIONS:  (//HUMAN  //OBJECT)) 

(OEFS  //REACTION  UP  /(MENTAL-PROCESS 
DOUN  (Z/UISH-FOR) ) 

(DEFS  Z/UISH-FOR  UP  //REACTION 
RESTRICTIONS:  (//HUMAN  (EITHER:  //RELATION  //OBJECT) ) ) 

(DEFS  /'COGNITION  UP  MENTAL -PROCESS 
DOUN  (//NEUTRAL-COGNITION  Z/VALUE-ASSIGNEO) ) 

(DEFS  //NEUTRAL-COGNITION  UP  //COGNITION 
DOUN  (//KNOU;) 

(DEFS  //KNOU  UP  //NEUTRAL-COGNITION 
RESTRICTIONS:  (//HUMAN  //FACT)) 

(DEFS  //VALUE-ASSIGNEO  UP  //COGNITION 
DOUN  (//ASSUME)) 


188 


APPENDIX  D.  SAM°LE  SEMANTIC  REPRESENTATION 

A sample  representation  of  the  sentence,  "Ein  deutlich  eichtbaree  Zeichen  fOr 
die  i£  Nervensysten  verlaufenden  Erregungen  ist  das  Spiel  der  Chroma tophoren 
der  Cephalopoden. " Semantic  structures  produced  for  tense  and  those  produced 
by  determiners  have  been  omitted  for  clarity. 
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APPENDIX  0.  (COND.) 


